DistantJob Logo

DistantJob

Senior Data Engineer

Reposted 2 Months Ago
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Design and optimize SQL Server solutions, manage data, automate processes with PowerShell, and integrate with external systems to enhance functionality.
The summary above was generated by AI

Cheesy joke to get you to smile:

Two SQL transactions ask a minister to marry them, but the minister replies, "Only if you're willing to commit."

Summary:

We are seeking a hands-on Data Engineer who is skilled in building complex systems beyond just writing queries. This role focuses on SQL Server in both Linux and Windows environments and requires versatility across various tools, including PowerShell, APIs, Python, and emerging AI/LLM technologies. If you enjoy stretching your expertise beyond SQL and want to contribute to innovative solutions, this position is for you. The role is for one of our North American clients with proprietary software for the insurance industry.


Responsibilities:

  • Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling.
  • Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets.
  • Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE.
  • Use PowerShell, SQL Server tools, and scripting to automate processes.
  • Enhance functionalities by integrating with APIs and external systems.
  • Address problems comprehensively, focusing on end-to-end solutions beyond the database layer.
  • Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks.
  • Explore and implement LLM-driven workflows, including prompting and structured outputs.
  • Continuously enhance efficiency by replacing manual processes with automation.

Required Skills:

  • Proficient in SQL Server, including query performance, indexing, and data modeling.
  • Experience handling JSON in SQL Server and managing hybrid data models.
  • Experience with PowerShell or similar scripting languages for automation purposes.
  • Ability to work across multiple systems, including databases, APIs, and services.
  • Proven ability to deliver effective solutions in a timely manner.

Preferred Skills:

  • Background in smaller teams with end-to-end system ownership.
  • Experience in complex application environments rather than isolated reporting or analytics settings.
  • Capability to navigate and solve problems without detailed requirements.
  • Experience in insurance, financial services, or other regulated, transaction-heavy domains.
  • Python experience and familiarity with APIs and integrations.
  • Exposure to LLMs like OpenAI and Claude.
  • Experience developing internal tools or automation frameworks.
  • Experience with cloud or hybrid infrastructure.

This is a fully remote position, offering the flexibility to work from anywhere. If you are ready to take ownership and thrive in a fast-paced, adaptive environment, we encourage you to apply!

Similar Jobs

Yesterday
Remote
Canada
Senior level
Senior level
Kids + Family • Mobile
Own and improve Life360’s Ads Data Engineering platform on Databricks. Build, operate, and optimize batch and streaming pipelines, Delta Lake tables, dbt models, semantic layers, and core metrics. Integrate advertising and business data, implement quality and governance controls, manage AWS infrastructure with Terraform, reduce compute costs, and mentor engineers. Partner with analysts, ad strategists, and sales teams to deliver trusted data products while developing AI-assisted engineering tools and workflows.
Top Skills: AirflowAmazon S3SparkAWSAws IamCi/CdClaude CodeCursorDatabricksDatabricks Asset BundlesDatabricks JobsDatabricks WorkflowsDbtDelta LakeDomoGitGithub CopilotLlmsLookerPysparkPythonScalaSQLSql WarehousesStructured StreamingTableauTerraformUnity Catalog
4 Days Ago
In-Office or Remote
Senior level
Senior level
Music
Own and develop production data pipelines and GCP-based data warehousing infrastructure supporting finance, analytics, and reporting across Beatport. Build scalable dbt and BigQuery data models, maintain RDBMS integrations and APIs, migrate legacy ETL solutions, document data systems, and resolve pipeline incidents. The role requires strong SQL and Python skills, cloud orchestration experience, attention to data integrity, and the ability to manage stakeholder requests independently.
Top Skills: Apache AirflowCloud ComposerCloud RunDbtGoogle BigqueryGoogle Cloud Platform (Gcp)Google Cloud Storage (Gcs)JenkinsMicrosoft Sql ServerMySQLOraclePentahoPostgresPythonRest ApisSftpSQL
One Month Ago
In-Office or Remote
CA
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account