Fusemachines Logo

Fusemachines

Lead Flink Data Engineer IoT

Posted Yesterday
Be an Early Applicant
In-Office
Toronto, ON
Senior level
In-Office
Toronto, ON
Senior level
Lead design, implement, and maintain scalable real-time Flink streaming pipelines for IoT sensor data on Azure. Build custom ProcessFunctions, state management, data quality gates, and optimize Flink clusters and state backends. Collaborate with teams to integrate libraries, enforce data governance and security, document solutions, and support CI/CD and Agile delivery.
The summary above was generated by AI

About Fusemachines

Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, the United States, Canada, and the Dominican Republic) and more than 450 full-time employees, Fusemachines brings global AI expertise to transform companies worldwide. Founded in 2013, Fusemachines is a global provider of enterprise AI products and services, on a mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise Transformation, regardless of where they are in their Digital AI journeys. With offices in North America, Asia, and Latin America, Fusemachines provides a suite of enterprise AI offerings and specialty services that allow organizations of any size to implement and scale AI. Fusemachines serves companies in industries such as retail,  manufacturing, and government.

Fusemachines continues to actively pursue the mission of democratizing AI for the masses by providing high-quality AI education in underserved communities and helping organizations achieve their full potential with AI.

Type: Remote, Full-time

Job Description

This is a role responsible for designing, building, and maintaining the real-time streaming infrastructure required for sensor data integration, complex state processing, and alerting in the Industrial IoT / Smart Buildings domain.

We are seeking a Lead Data Engineer with expert-level Apache Flink (Java and SQL) skills, and proven implementation of custom ProcessFunctions, state management, and real-time data quality gates, delivering Data and Analytics products using Agile methodology. The ideal candidate will possess strong technical, analytical, and interpersonal skills.

Qualification / Skill Set Requirement:

  • 5+ years of hands-on data engineering experience with deep expertise in the Azure ecosystem.
  • 5+ years in Java (backend) with 3+ years deep specialization in Apache Flink (DataStream API & SQL).
  • Experience with Flink State Management, Checkpointing, and Watermark strategies.
  • Experience upgrading to or using Flink 2.0/2.x.
  • Experience with Azure Event Hubs or Kafka.
  • Understanding of "Sensor/IoT" data patterns (out-of-order and missing events).
  • Proficient in Java, SQL, and writing optimized data integration and processing code.
  • Strong understanding of SDLC and Agile methodologies with hands-on experience in Azure DevOps, GitHub, CI/CD, and artifact management.
  • Deep expertise in Azure data services.
  • Skilled in data modeling, database design, and data warehousing solutions on Azure.
  • Knowledge of data quality, governance, and security best practices within Azure (AD, NSG, encryption, compliance).
  • Certifications preferred: Azure Fundamentals, Azure Data Engineer Associate, and Azure Solutions Architect Expert (nice to have).

Responsibilities

  • Architect, design, and implement scalable and efficient data solutions on Flink.
  • Design and implement the Flink 2.x streaming pipeline for IoT.
  • Develop custom KeyedProcessFunctions to handle "Heartbeat Injection" (detecting sensor silence) and complex windowing.
  • Implement the Gatekeeper Pattern: A Flink job that applies Data Quality tags (Validity, Completeness) to the stream without dropping data.
  • Optimize State Backends for high-cardinality sensor data (100k+ concurrent sensors).
  • Work with the "Shared Core" team to integrate libraries into the Flink runtime.
  • Manage and optimize Azure resources (Flink clusters) for performance, reliability, and cost-efficiency.
  • Transform, clean, and prepare data using SQL, and Java.
  • Monitor and fine-tune workloads and pipelines for optimal performance and reliability.
  • Maintain clear documentation of solutions, configurations, and workflows.
  • Actively participate in Agile team activities and continuous improvement initiatives.
  • Promote and enforce data engineering best practices, including data governance, security, and data quality.

Fusemachines is an Equal Opportunities Employer, committed to diversity and inclusion. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other characteristic protected by applicable federal, state, or local laws.

Top Skills

Apache Flink
Apache Kafka
Azure
Azure Active Directory (Ad)
Azure Data Services
Azure Devops
Azure Event Hubs
Checkpointing
Ci/Cd
Data Warehousing (Azure)
Flink 2.X
Flink Datastream Api
Flink State Management
Git
Java
Keyedprocessfunctions
Network Security Group (Nsg)
SQL
State Backends
Watermark Strategies

Similar Jobs

An Hour Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Serve as the single procurement contact for a site/country cluster, managing stakeholder interactions, ensuring material availability, supporting sourcing projects and spot buys, owning source-to-pay compliance KPIs, and implementing regional/global procurement initiatives to support manufacturing, supply chain and commercial teams.
An Hour Ago
Remote or Hybrid
8 Locations
Mid level
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Field-driven Territory Account Executive responsible for full-cycle, self-sourced sales: prospecting, live demos, closing deals, building pipeline, partnerships, and managing Salesforce-based forecasting and onboarding to exceed quota.
Top Skills: Salesforce
An Hour Ago
Remote or Hybrid
8 Locations
Mid level
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
The role involves managing the onboarding of US merchants, ensuring timely activation and implementation while fostering strong cross-functional relationships.
Top Skills: Network ConfigurationPaymentsPosProject ManagementSoftware Implementation

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account