Develop and manage scalable ETL/ELT pipelines with Apache Airflow and Python, integrating data from various sources while ensuring compliance and data integrity.
Senior Integration Developer1
- We are seeking a skilled and motivated Data Integration Developer with strong expertise in Python and hands-on experience in building and managing Apache Airflow pipelines. The ideal candidate will be responsible for developing, maintaining, and optimizing data integration workflows that support our enterprise data platform and analytics initiatives.
- Design, build, and manage scalable and maintainable ETL/ELT pipelines using Apache Airflow and Python.
- Integrate data from multiple sources (databases, APIs, flat files, cloud services, etc.) into data warehouses or data lakes.
- Develop reusable Python modules and scripts to support data transformation and validation.
- Collaborate with data engineers, analysts, and platform teams to understand integration requirements and deliver solutions.
- Monitor, debug, and improve Airflow DAGs for performance, reliability, and fault tolerance.
- Ensure data integrity and compliance with enterprise data governance policies.
- Maintain documentation for integration workflows and operational procedures.
- Strong proficiency in Python with experience writing modular, testable, and reusable code.
- Hands-on experience with Apache Airflow (writing custom DAGs, operators, and managing schedules).
- Experience with data integration, ETL/ELT processes, and working with structured/unstructured data.
- Familiarity with relational databases (e.g., PostgreSQL, MySQL, SQL Server) and writing efficient SQL queries.
- Experience integrating with REST APIs, file systems (SFTP/FTP), and cloud storage (S3, Azure Blob, etc.).
- Understanding of CI/CD practices and version control (e.g., Git).
- Strong problem-solving skills and attention to detail.
Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries of the position across all US locations. Within the range, individual pay is determined by work location and additional job-related factors, including knowledge, skills, experience, tenure and relevant education or training. The pay scale is subject to change depending on business needs. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Additional compensation may include benefits, discretionary bonuses, and equity.
Top Skills
Apache Airflow
MySQL
Postgres
Python
SQL Server
Similar Jobs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design, build, and maintain enterprise integrations and automations across procurement, finance, and supply chain systems using iPaaS platforms, APIs, Python, and SQL; collaborate with stakeholders, test and monitor integrations, and drive reliability and scalability.
Top Skills:
AirflowAWSCi/CdDatabricksFivetranGitGoJavaKotlinLambdaLookerMulesoftOracle Fusion CloudPrefectPythonRdsS3SalesforceSnowflakeSQLSqsZip Ipaas
Marketing Tech • Software
In this role, you will own and evolve core integration and data systems, design cloud services, manage business-critical data flows, and ensure secure and cost-effective operations.
Top Skills:
BigQueryCloud RunDockerGoGoogle Cloud PlatformGrpcJavaScriptPub/SubPythonRestTerraform
Artificial Intelligence
Responsible for software integration and quality for Cerebras AI platform, focusing on automation, debugging, and cross-team collaboration. Develops QA strategies and testing methodologies to ensure product quality.
Top Skills:
C++GoMicroservicesMl FrameworksPython
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
