Build, maintain, and scale ETL pipelines and data infrastructure supporting analytics, data science, and data products. Collaborate with data scientists, analysts, engineers, and product managers to improve architecture reliability and performance. Develop Python tools and services, work with batch and streaming systems, research new technologies, and promote effective data engineering practices. This is a 12-month fixed-term maternity cover role with hybrid work in Toronto.
The summary above was generated by AI
Wattpad’s vision is to entertain and connect the world through stories. A leading global webnovel platform, Wattpad has democratized storytelling for a new generation of diverse Gen Z writers and their fans. Wattpad is part of WEBTOON Entertainment’s IP & Creator Ecosystem, where approximately 155 million monthly active users discover incredible stories in multiple formats. Come build the future of entertainment and storytelling with our global team, and write your next chapter with us!
Wattpad is part of the WEBTOON Entertainment family of brands, home to some of the world's largest storytelling platforms. With approximately 155 million monthly active users, WEBTOON Entertainment’s IP & Creator Ecosystem of aligned brands and platforms include WEBTOON, Wattpad--the world’s leading webnovel platform--WEBTOON Productions, Studio N, Studio LICO, WEBTOON Unscrolled, LINE MANGA, and eBookJapan, among others. To read more about our family of Brands, check out our website here.
Wattpad follows a hybrid work model, with employees working from our vibrant downtown Toronto office 3x per week.
We are seeking a Data Engineer who is passionate about diving deep into data infrastructure, creating and enhancing data pipelines, and someone who thrives in a product focused environment. This role is an important role for our Data Engineering team. The purpose of the Data Engineering team is to empower engineers, analysts, and data scientists with tools that enable and streamline data-driven decision making, analysis, and feature development.
Please note this is a 12-month fixed term contract to backfill a maternity leave.
What You'll Do:
Coordinate with data scientists, data analysts, software engineers and product managers to design and evolve our existing architecture, improving the reliability and performance of our data infrastructure
Build, maintain and scale our ETL pipelines to help power data science, data products and analytical needs
Design, build, and maintain data infrastructure systems such as but not limited to AWS DMS, HBase, EMR, Redshift, S3, Kafka, Airflow while ensuring scalability, reliability, and security
Write new tools, services, and platforms in Python
Research new technologies to solve tomorrow’s data infrastructure needs
Advocate for the adoption of tools in the data engineering team
Required Qualifications:
4+ years of data engineering experience
Ability to write high-quality code in Python and PySpark
Strong understanding of database fundamentals and software engineering principles
Strong understanding of Data Contracts, microservices principles, and treating datasets/platforms as API-driven products
Deep understanding of two or more of these technologies: Spark, Airflow, AWS EMR, AWS Glue, Sagemaker and Redshift
Experience with batch processing and streaming systems
Exposure and/or strong interest in Kafka or other queuing technologies
A critical thinker and possess creative problem solving skills
Quantitative skills, ability to think analytically, and strong attention to details
A desire to contribute to the broader development community
.png)
