Okta Logo

Okta

Senior AI/ML Engineer - Intelligence Accelerator

Reposted 4 Days Ago
In-Office
Toronto, ON
Expert/Leader
In-Office
Toronto, ON
Expert/Leader
As a Principal Software Engineer, you will design and optimize data-intensive platforms, lead engineering teams, mentor junior staff, and ensure system reliability in a fast-paced environment.
The summary above was generated by AI

Get to know Okta
Okta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth.
At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we’re looking for lifelong learners and people who can make us better with their unique experiences. 
Join our team! We’re building a world where Identity belongs to you.

About the Role

The Intelligence Accelerator team in the Data Platform Group is the engine behind Okta’s AI/ML evolution. We are responsible for building the foundational AI/ML services and systems that fast-track AI/ML for Okta and deliver differentiated value to our users. Working hand-in-glove with the Data Platform team, Data Scientists, Product Managers, and the SREs, you will bridge the gap between data, research and platform offerings, playing a critical role in enabling the technical adoption of ML and Generative AI across the company.

We are assembling an elite unit designed to be fast, creative, and flexible. We practice extreme ownership. We expect great things from our engineers and reward them with stimulating challenges, novel technologies, and the chance to hold equity. Join the Intelligence Accelerator and help us change the cloud security landscape forever.

As a Senior Machine Learning Engineer within the Intelligence Accelerator team, you will contribute to the development of our next-generation AI/ML platform. You will work with the team to build the "paved road" that empowers Okta’s Applied AI teams to rapidly build and deploy intelligent features—enabling leveraging classical models, LLMs and autonomous agents.

You will join a group that prioritizes engineering rigor—designing for scale, rigorous code reviews, automated testing, and CI/CD for ML (MLOps). In this role, you will:

  • Contribute to the Foundation: Help design and maintain scalable infrastructure for core machine learning lifecycles, including distributed training clusters, real-time inference serving, and high-performance feature stores.
  • Implement Agentic Infrastructure: Work on the bleeding-edge stack for Agentic AI, helping to implement standards like the Model Context Protocol (MCP) to securely connect LLMs with internal tools, data, and APIs.
  • Enable Applied AI: Build internal developer tooling that allow our product engineering teams to leverage Generative AI workflows, RAG pipelines, and vector databases without worrying about the underlying infrastructure.

This is your opportunity to build the systems that power Okta’s future, working with emerging tech stacks in a fast, flexible, and elite environment

What You'll Do
  • Architect & Deploy ML Infrastructure: Design, build, and maintain robust, scalable ML infrastructure using modern tools (Airflow, MLFlow, feature stores, vector databases) while implementing automated CI/CD workflows for model training, validation, and deployment.
  • Drive Innovation & Security: Evaluate and adopt new ML technologies while ensuring data security, privacy, and compliance within the ML infrastructure
  • Build Scalable Data Pipelines: Design and maintain pipelines to ingest, process, and transform data from various sources, data warehouses, ensuring data quality, security, and compliance of data feeding into ML models and offline model artifact deployment
  • Optimize & Monitor Systems: Deploy and monitor ML systems with data scientists and engineers, troubleshoot infrastructure issues, and optimize their performance
  • Collaborate & Evangelize: Work with cross-functional teams to align AI/ML platform strategies with company objectives while acting as an AI/ML evangelist and provide mentorship to analysts and stakeholders.
What You'll Bring
  • Engineering Experience: 5+ years of software engineering experience with a strong focus on backend systems, distributed computing, or cloud infrastructure (AWS/GCP/Azure).
  • ML Infrastructure: Experience building and scaling ML platforms using technologies like Kubernetes, Ray, Kubeflow, or similar orchestration tools.
  • Production Mindset: You treat infrastructure as code. You have a track record of implementing CI/CD pipelines, automated testing, and observability for Machine Learning workloads.
  • GenAI Fluency: Familiarity with the modern LLM stack (e.g., LangChain, vector databases, RAG patterns) and an interest in emerging standards like Model Context Protocol (MCP) and Agentic workflows.
  • Language Proficiency: Expert-level proficiency in Python and familiarity with Go, Java, or C++.
  • Collaborative Spirit: Experience working directly with Data Scientists or Applied AI teams to translate research needs into robust production systems
Nice to Have
  • Experience with Java and/or Java EE web applications.
  • Familiarity with authentication protocols, access management, or cloud security best practices.
  • Exposure to prompt engineering, LLM ecosystems (Hugging Face, LangChain, vector databases), and identity and access management or security focused ML applications.

**This person must attend in person orientation in Toronto the first week of work. 

#LI-Hybrid
#LI-BB1

P16359_3280416

Below is the annual base salary range for candidates located in San Francisco Bay Area. Your actual base salary will depend on factors such as your skills, qualifications, experience, and work location. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program please visit: https://rewards.okta.com/us.   

The annual base salary range for this position for candidates located in the San Francisco Bay area is between:
$144,000$194,000 CAD

What you can look forward to as a Full-Time Okta employee!

  • Amazing Benefits
  • Making Social Impact
  • Developing Talent and Fostering Connection + Community at Okta

Okta cultivates a dynamic work environment, providing the best tools, technology and benefits to empower our employees to work productively in a setting that best and uniquely suits their needs. Each organization is unique in the degree of flexibility and mobility in which they work so that all employees are enabled to be their most creative and successful versions of themselves, regardless of where they live. Find your place at Okta today! https://www.okta.com/company/careers/.
Some roles may require travel to one of our office locations for in-person onboarding.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.
If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.
Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Personnel and Job Candidate Privacy Notice at https://www.okta.com/legal/personnel-policy/.

Top Skills

Beam
Flink
Hadoop
Java
Kafka
Kinesis
Kubernetes
Snowflake
Spark

Okta Toronto, Ontario, CAN Office

401 Bay St., Toronto, ON, Canada, M5H 2Y4

Similar Jobs

18 Days Ago
Easy Apply
In-Office
Toronto, ON, CAN
Easy Apply
Senior level
Senior level
Hardware • Manufacturing
The Sr. SoC Design Verification Engineer ensures functionality and performance of AI/ML accelerator chiplets by designing and executing test plans and collaborating with technical teams.
Top Skills: C/C++PythonSystemverilog/Uvm
An Hour Ago
Remote or Hybrid
8 Locations
Senior level
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
As a Retention Account Manager, you will engage with SMB owners, deploy retention strategies to reduce churn, and support clients to help them grow. You will collaborate with various teams to enhance retention efforts.
Top Skills: Account ManagementSales
An Hour Ago
In-Office
Ottawa, ON, CAN
Internship
Internship
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
As a Mechanical Design Coop, you will participate in the design of 5G radio products and update design documentation while supporting testing and enhancing lab environments.
Top Skills: AutocadCreoSolidworks

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account