Design, build, and optimize Databricks-based data and ML platforms. Own ETL pipelines, Delta Lake lakehouse, MLflow model lifecycle, MLOps, cluster optimization, RAG/LLM solutions, BI integration, and data governance with Unity Catalog.
Job Summary
We are seeking a highly skilled Databricks Engineer with
AI/ML experience to design, build, and optimize scalable data and machine
learning platforms on Databricks. The role involves end-to-end ownership of
data pipelines, ML workflows, and production AI systems.
Key Responsibilities
- Design
and implement scalable ETL pipelines using Databricks & Spark
- Build
Lakehouse architecture using Delta Lake
- Develop
and deploy ML models using MLflow
- Implement
MLOps pipelines for training, testing, and serving models
- Optimize
cluster performance and reduce compute cost
- Build
RAG and LLM-based solutions using Mosaic AI
- Integrate
analytics with BI tools (Power BI, Tableau)
- Implement
data governance using Unity Catalog
- Collaborate
with Data Scientists and Business teams
- Ensure
data quality, security, and compliance
Required Skills
Mandatory
- 5+
years of Databricks & Apache Spark
- Strong
Python & PySpark
- Experience
with Delta Lake & Lakehouse
- MLflow
& MLOps experience
- Cloud
platform (AWS/Azure/GCP)
- Git
& CI/CD
Preferred
- Experience
with LLMs & Generative AI
- RAG
pipelines & Vector Databases
- Deep
Learning frameworks
- Databricks
certifications
- Power
BI integration
Requirements
Job Summary
We are seeking a highly skilled Databricks Engineer with
AI/ML experience to design, build, and optimize scalable data and machine
learning platforms on Databricks. The role involves end-to-end ownership of
data pipelines, ML workflows, and production AI systems.
Key Responsibilities
- Design
and implement scalable ETL pipelines using Databricks & Spark
- Build
Lakehouse architecture using Delta Lake
- Develop
and deploy ML models using MLflow
- Implement
MLOps pipelines for training, testing, and serving models
- Optimize
cluster performance and reduce compute cost
- Build
RAG and LLM-based solutions using Mosaic AI
- Integrate
analytics with BI tools (Power BI, Tableau)
- Implement
data governance using Unity Catalog
- Collaborate
with Data Scientists and Business teams
- Ensure
data quality, security, and compliance
Required Skills
Mandatory
- 5+
years of Databricks & Apache Spark
- Strong
Python & PySpark
- Experience
with Delta Lake & Lakehouse
- MLflow
& MLOps experience
- Cloud
platform (AWS/Azure/GCP)
- Git
& CI/CD
Preferred
- Experience
with LLMs & Generative AI
- RAG
pipelines & Vector Databases
- Deep
Learning frameworks
- Databricks
certifications
- Power
BI integration
iLink Digital Oakville, Ontario, CAN Office
2196 Galena Crescent , , Oakville, ON , Canada, L6H 4A8
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Design and build scalable backend systems, APIs, data models, event-driven services, experimentation platforms, and personalization systems. Partner with Product, Data Science, Analytics, and Design teams to support customer acquisition and engagement. Establish secure, observable, high-performance engineering practices, mentor junior engineers, and participate in monitoring, on-call, and operational support.
Top Skills:
A/B Testing FrameworksAWSFeature Flagging SystemsKafkaKinesisKotlinPython
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and operate Block’s data platform, including warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop reliable Python services, developer tools, and Terraform infrastructure for petabyte-scale data. Partner with data practitioners and product teams, establish engineering standards, provide technical direction, and mentor engineers while ensuring security, reliability, observability, usability, and data governance.
Top Skills:
AnomaloApache AirflowApache IcebergAWSBuildkiteDatabricksDatahubDbtGitopsKotlinLookerOmniPrefectPythonSnowflakeTerraform
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Build and operate a scalable data platform supporting warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop Python services, Terraform infrastructure, and developer tools for petabyte-scale data. Partner with data practitioners and product teams, establish security and reliability patterns, set technical direction, improve engineering standards, and mentor engineers.
Top Skills:
AnomaloApache AirflowApache IcebergAWSBuildkiteDatabricksDatahubDbtGitopsKotlinLookerOmniPrefectPythonSnowflakeTerraform
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
