NVIDIA Logo

NVIDIA

Senior Machine Learning Applications and Compiler Engineer, LPX

Posted 21 Days Ago
Be an Early Applicant
Remote or Hybrid
2 Locations
Senior level
Remote or Hybrid
2 Locations
Senior level
Develop high-performance machine learning inference runtimes and compiler components for NVIDIA platforms. Optimize neural network graph mappings through compiler transformations, scheduling, memory layouts, profiling, and benchmarking. Collaborate with hardware architects on codesign, evaluate spatial accelerator techniques, and contribute to NVIDIA’s software ecosystem. The role also involves research, technical publications, and presentations on compilation and inference optimization.
The summary above was generated by AI

We are now looking for a Senior Machine Learning Applications and Compiler Engineer!

 

NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads map onto future NVIDIA platforms. This is your chance to be part of something outstandingly innovative!

 

What you’ll be doing:

  • Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.

  • Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.

  • Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.

  • Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.

  • Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.

  • Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.

  • Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.

 

What we need to see:

  • MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.

  • Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.

  • Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.

  • Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.

  • Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.

  • Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.

  • Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.

  • Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.

  • Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.

 

Ways to stand out from the crowd:

  • Prior work on spatial or dataflow architectures, including static scheduling, pipeline parallelism, or tensor parallelism at scale.

  • Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas related to performance or scalability.

  • Demonstrated research impact, such as publications or presentations at conferences like PLDI, CGO, ASPLOS, ISCA, MICRO, MLSys, NeurIPS, or similar.

  • Experience with large-scale AI distributed inference or training systems, including performance modeling and capacity planning for multi rack deployments.

 

#LI-Hybrid

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
135,000 CAD – 185,000 CAD for Level 3; and 170,000 CAD – 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 23, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA Toronto, Ontario, CAN Office

Toronto, Ontario, Canada

Similar Jobs

An Hour Ago
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex, cross-functional technology programs and projects from initiation through delivery. Establishes governance, delivery plans, milestones, dependencies, risk frameworks, and stakeholder cadences. Partners with Product and Engineering leadership to translate strategic roadmaps into executable release plans, manages critical-path issues and escalations, and drives release readiness across multiple teams. The role also improves program execution, release governance, transparency, quality, and delivery velocity in a healthcare technology environment.
Top Skills: AgileAha!Hybrid Delivery ModelsJIRASoftware Development Lifecycle (Sdlc)
7 Hours Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage strategic customer relationships after implementation, creating success plans, conducting executive business reviews, leading workshops, supporting French-speaking implementations, and advising customers on Samsara’s IoT platform. Collaborate with Sales, Support, Engineering, and Product to solve problems, drive adoption, remove barriers, and deliver measurable operational value. Mentor Customer Success and Support teams while promoting customer-focused company principles.
Top Skills: IotSaaSSamsara Connected Operations Cloud
7 Hours Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Architect, develop, debug, test, deploy, and support customer-facing firmware features in C/C++ and Golang for cloud-connected hardware. Build observability and rollout metrics for more than 1.5 million devices, triage customer and QA issues, and collaborate across hardware, networking, product, support, and engineering teams to deliver reliable IoT vehicle intelligence products.
Top Skills: BuildkiteC++CanCan-UtilsDatabricksGoGraphQLIotLinuxLinux DriversLteUsbWi-Fi

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account