Similar Jobs
AdTech • Digital Media • eCommerce • Marketing Tech
As a Senior Data Engineer, you'll build scalable data pipelines, optimize data models, and ensure pipeline performance using Databricks, PySpark, and Kafka while collaborating cross-functionally with Architects and Scientists.
Top Skills:
AWSCi/CdDatabricksDelta LakeGitKafkaPysparkSparkSQL
Big Data • Cloud • Healthtech • Software • Big Data Analytics
The AI Data Engineer will ensure the reliability of Veeva AI Agents through evaluation, validation, and testing of data integrity and performance metrics.
Top Skills:
PytestPython
Big Data • Cloud • Healthtech • Software • Big Data Analytics
The role involves ensuring the reliability of Veeva AI Agents through evaluation strategies, LLM output integrity assessments, and automation of evaluation pipelines while debugging and reporting performance metrics.
Top Skills:
Ci/Cd SystemsPytestPython
We are seeking an experienced Data Engineer with expertise in ETL and BI toolsets to join our Technology Consulting team. You will work with amazing development teams on a variety of assignments with different clients. By gathering requirements, doing analysis, and consulting with clients, you will be able to lay a solid data foundation to perform robust analytics. You will have the opportunity to build your technical skills and expertise in ETL, BI and Cloud as well as expand your consulting skills. You are a team player with a true passion for data and a desire to learn and grow in your career.
What you'll do:
- Design ETL process and data flow from source systems to data warehouses.
- Develop and unit test ETL processes for optimal performance and performance-tune ETL mappings and report queries.
- Design and develop Business Intelligence solutions to meet end user demands.
- Design physical database objects including fact tables, dimensions, staging, materialized views, indexes etc.
What we'd like:
- 7+ years' hands-on experience in tuning ETL jobs to reduce run-time and increase efficiency through code tuning, hardware deployment, and architecture changes.
- Experience designing and building BI visualizations to meet client needs.
- Experience with ETL tools such as Ab Initio, Informatica, Microsoft SSIS, IBM DataStage, SAP Data Services etc.
- Ability to interact with clients and business users and analyze complex business requirements.
- Experience with BI tools such as Tableau, Power BI, and MicroStrategy.
- Practical experience with Windows, UNIX, relational databases (Oracle, SQL Server), SQL, and/or Oracle PL/SQL.
- Strong understanding of data warehousing architectures, core concepts, methodologies, and best practices.
- Detail oriented with analytical and problem-solving skills to recognize and identify issues and take proper action to resolve them.
- Experience using software development tools such as Azure DevOps, JIRA, Confluence, Source Code Management, and CI/CD pipelines is considered an asset.
- Keeping up to date on latest technology trends.
- Experience with AWS, Azure and/or GCP is strongly preferred.
- Expertise in coding with Python is strongly preferred.
- Experience with AI and Machine Learning is an asset.
Online Business Systems Toronto, Ontario, CAN Office
607-130 Spadina Ave., Toronto, ON, Canada, M5V 2L4
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
