Design, develop, and maintain Azure-based ETL/ELT pipelines and data platforms. Build transformations with Databricks, PySpark, and SQL; manage Azure SQL data models and performance tuning; execute on-premises-to-Azure migrations; deploy Azure applications; implement secure storage with ADLS Gen2 and Delta Lake; and monitor, troubleshoot, and optimize cloud data resources.
Job Summary:
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
Build and optimize complex data transformation logic using Azure Databricks (PySpark and SQL).
Lead and execute on-premises to Azure cloud migrations for data platforms, ETL workflows, and applications.
Develop, deploy, and support applications using Azure App Service and Azure Functions.
Design data models and perform query optimization and performance tuning using Azure SQL.
Implement and manage data storage solutions using Azure Data Lake Storage Gen2 (ADLS Gen2) and Delta Lake.
Apply robust data orchestration, scheduling, and error-handling patterns to ensure reliable data processing.
Leverage core Azure services such as VNets, Storage Accounts, Key Vault, and IAM to build secure and scalable cloud solutions.
Monitor, troubleshoot, and optimize data pipelines and Azure resources using appropriate monitoring tools.
Required Skills & Qualifications
Strong hands-on experience with Azure Data Factory (ADF).
Proven expertise in Azure Databricks, including PySpark and SQL-based data transformations.
Hands-on experience in developing and deploying solutions using Azure App Service and Azure Functions.
Solid experience in on-premises-to-Azure migration projects, particularly for data platforms.
Advanced SQL skills, including data modeling, query optimization, and performance tuning in Azure SQL.
Working knowledge of Delta Lake, ADLS Gen2, and modern data lake architectures.
Good understanding of core Azure services and cloud security best practices.
Experience with monitoring and troubleshooting using Azure Monitor and Application Insights.
Kumaran Systems Toronto, Ontario, CAN Office
703 Evans Avenue, Suite 605 , Toronto, ON , Canada, M9C 5E9
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, develop, and optimize enterprise data pipelines and ETL/ELT integrations using Informatica IDMC. Build transformation workflows, integrate multiple data sources into cloud and enterprise environments, troubleshoot performance and data quality issues, and implement testing and monitoring. Collaborate with architects, analysts, engineers, and business stakeholders to deliver scalable data solutions, primarily for financial services clients.
Top Skills:
Automated TestingAWSAzureCi/CdData PipelinesEltETLGCPInformatica IdmcPythonRelational DatabasesSQLVersion Control
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop secure integrations enabling AI agents and applications to access exchange market data. Build backend services and APIs using Python, Java, or comparable technologies; implement authentication, authorization, identity management, licensing, entitlements, and usage controls. Apply market-data distribution expertise and AI integration patterns such as LLMs, agentic AI, and MCP while collaborating with financial institutions and technology stakeholders.
Top Skills:
Agentic AiApi GatewaysAPIsAuthenticationAuthorizationCloud-Based Data ServicesIdentity ManagementJavaLlmsModel Context Protocol (Mcp)OauthPython
Fintech • Machine Learning • Payments • Software • Financial Services
Leads hands-on data and software engineering across the full development lifecycle. Owns technical design, architecture, development, engineering standards, developer experience, and fault-tolerant application systems. Provides technical guidance to stakeholders, establishes best practices, contributes to high-level design, and mentors junior and intermediate engineers. The role requires expertise in application development, data modeling, cloud platforms, and modern software engineering practices within an agile financial-services environment.
Top Skills:
AWSCloud ComputingContainersGoGCPJavaMicroservicesAzurePythonRestful Apis
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
