Build and operate automation and tooling for large-scale NVIDIA GPU infrastructure. Responsibilities include bare-metal provisioning, hardware validation, firmware and software upgrades, cluster lifecycle management, BMC and Redfish integration, failure diagnosis, automated recovery, production handoff, on-call support, incident response, and root-cause analysis across hardware, networking, Linux, Kubernetes, and distributed services.
NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We are looking for Software Engineers with SRE or Production Engineering experience who have worked hands-on with bare-metal NVIDIA systems. This team builds the software and operational tooling that moves GPU capacity from installed hardware to production service supporting an IaaS production environment of BMaaS, VMaaS.
What you’ll be doing:
- Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management.
- Develop tools that interact with BMC and Redfish interfaces to monitor hardware health, manage server state, and assist recovery workflows.
- Handle and advance NVIDIA NVL72 systems and BlueField-3 or later DPUs throughout cloud partner and on-premises environments.
- Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; turn recurring issues into automated detection and repair.
- Define validation and handoff criteria so new capacity enters production safely and consistently.
- Take part in on-call duties, incident response, root-cause analysis, and follow-up to implement permanent solutions.
- Work with hardware, networking, platform, data center operations, and partner teams to resolve issues across ownership boundaries.
What we need to see:
- 12+ years building software for or operating production infrastructure, including substantial hands-on bare-metal experience.
- Strong Go or Python skills, with a record of delivering production automation and services.
- Direct experience with BMC and Redfish in server provisioning, health inspection, power management, or fault diagnosis.
- Practical experience working directly with NVIDIA GPU hardware, such as NVL72 systems, and BlueField-3 or newer DPUs.
- Experience with Linux, firmware and driver management, network boot, and the server lifecycle from initial provisioning through repair.
- Experience managing production reliability through on-call duties, incident response, observability, and durable solutions.
- Ability to debug failures across hardware, host operating systems, networking, and distributed services.
- Clear communication and demonstrated ownership of problems that span multiple teams.
- BS/MS in Computer Science or equivalent experience in a practical setting.
Ways to stand out from the crowd:
- Experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, with DPU or equivalent experience considered.
- Background with NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.
- Experience building safe, repeatable workflows for rack-scale bringup, firmware upgrades, hardware replacement, and customer handoff.
- Experience with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation.
At NVIDIA, you’ll help make next-generation AI infrastructure production-ready at scale!
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 170,000 CAD – 220,000 CAD.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA Toronto, Ontario, CAN Office
Toronto, Ontario, Canada
Similar Jobs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Own end-to-end analytics engineering for AI and developer experience data. Instrument telemetry, build governed production pipelines, define trusted metrics, and create executive-facing dashboards and analyses. Partner with data engineering, AI, and data science teams to improve data quality and connect raw signals to decision-making. Present clear recommendations on AI investment, developer productivity, and ROI while using AI coding agents to build and maintain pipelines, dashboards, and analyses.
Top Skills:
Ai Coding AgentsCi/CdGitLlm-Based Classification ToolingMetrics StorePythonReactSnowflakeSQLTypescript
46 Minutes Ago
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Graduate research interns will own end-to-end projects to build customer world models and proactive intelligence: developing representation learning, foundation model, RL/agentic methods, evaluation frameworks, and shipping research into production to improve customer decision-making.
Top Skills:
Deep LearningFoundation ModelsJaxOptimizationPythonPyTorchRepresentation Learning
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and deploy agentic and generative AI systems that automate risk and compliance investigations. Own full-stack ML systems, including data integrations, prompt tuning, orchestration, evaluation, productionization, monitoring, and transformer-based modeling across transaction, graph, text, and profile data. Collaborate with product, engineering, platform, and operations teams while leading strategic roadmaps and delivering scalable production systems.
Top Skills:
Agentic AiAmazon Web Services (Aws)Apache AirflowGenerative AiGoogle Cloud Platform (Gcp)Large Language Models (Llms)Natural Language Processing (Nlp)PythonPyTorchSnowflakeTransformer Models
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
