The Senior Data Engineer will optimize data integrations for Retail, design ETL workflows, enhance BigQuery performance, and maintain data quality in a collaborative, growth-driven environment.
Softeta is an IT consulting and custom software development company that works with mid-sized and large businesses across Europe. We help clients modernize legacy systems, build tailored digital solutions, and prepare their data infrastructure for AI and automation.
We are looking for a skilled Data or Software Engineer to help improve, maintain, and optimize the data integrations used in reports for the Retail industry. Are you seeking a vibrant, open-minded space where your growth is nurtured and innovation thrives? Your opportunity could be just around the corner!
Responsibilities:
- Combine data from multiple sources such as APIs, databases, and third-party systems;
- Design and execute ETL/ELT workflows utilizing advanced data processing tools like Cloud Composer/Airflow, Dataflow;
- Develop robust and efficient data pipelines, implement processing logic, and perform data transformations;
- Enhance BigQuery queries and allocate resources effectively to minimize costs and boost performance;
- Maintain data quality, availability, and security by adhering to industry best practices.
Requirements
- Demonstrated experience as a Data or Software Engineer in Senior role;
- Prior experience with dbt and Python is advantageous;
- Familiarity with CI/CD systems like GitLab is required;
- Experience with any public Cloud service;
- Knowledge of Google Cloud and Cloud Data Warehousing is highly beneficial;
- Specifically, experience with BigQuery or Snowflake and their integration with dbt is preferred. Additionally, proficiency with Terraform is strongly desired.
Benefits
- Diverse and technically challenging projects;
- Flexible working hours and hybrid or remote workplace model;
- Flexible schedule and Agile/SCRUM environment;
- Technical equipment which you can choose.
Top Skills
Airflow
APIs
BigQuery
Cloud Composer
Cloud Data Warehousing
Databases
Dataflow
Dbt
Gitlab
GCP
Python
Snowflake
Terraform
Similar Jobs
Information Technology • Software
The Senior Data Engineer will design and implement batch and streaming data pipelines, evolve AWS data lake architecture, and mentor peers while ensuring optimal performance and cost efficiency.
Top Skills:
Amazon KinesisApache KafkaSparkAWSAws CdkAws CloudwatchCi/CdDelta LakeDockerSparkuiTerraform
Artificial Intelligence • Information Technology • Consulting
Design and maintain data pipelines and ML systems, implement MLOps practices, and collaborate with teams to address client challenges in AI and data projects.
Top Skills:
Apache AirflowSparkAWSBedrockClickhouseEcrGlueKafkaLambdaPythonRedshiftS3SagemakerSnowflakeSQL
Software
Develop and deliver data pipelines, manage deployments, ensure data quality, and support troubleshooting within the data delivery team.
Top Skills:
Azure Data FactoryCi/CdDbtGitSnowflakeSQL
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
