Boson AI Logo

Boson AI

Site Reliability Engineer

Reposted 3 Months Ago
In-Office
Toronto, ON, CAN
Mid level
In-Office
Toronto, ON, CAN
Mid level
Design, operate, and automate reliable infrastructure for large-scale AI training and inference. Own networking, compute, storage, GPU/server configuration, and operational tooling. Build monitoring, alerting, runbooks, incident response, capacity planning, provisioning automation, and collaborate with ML and platform teams to improve performance and reliability.
The summary above was generated by AI
About The Role
 
Boson AI builds production-grade AI systems that make communication with AI more natural, capable, and useful. We are looking for a Site Reliability Engineer to help build and operate the infrastructure behind that work.
 
Based in Toronto, you will work across the systems that enable large-scale AI training and serving: high-performance networks, GPU clusters, storage, scheduling, and the operational tooling that keeps them reliable. This is a hands-on role for someone who enjoys taking complex infrastructure from “it works” to dependable, observable, and scalable.
 
You do not need to be an expert in every layer of the stack. We are looking for deep strength in at least one area—networking, cluster scheduling, storage, GPU systems, or AI infrastructure— and the curiosity and judgment to collaborate across the rest.
 

Responsibilities

  • Design, operate, and improve reliable infrastructure for AI training and inference workloads
  • Own and automate operational workflows across one or more core areas: networking, compute allocation, storage, GPU/server configuration, or AI platforms
  • Build monitoring, alerting, runbooks, and incident-response practices that make systems easier to operate
  • Diagnose performance, capacity, and reliability issues across hardware, operating systems, networks, schedulers, and distributed workloads
  • Partner closely with ML, research, and platform teams to translate workload needs into practical infrastructure improvements
  • Improve provisioning, configuration management, testing, and deployment automation
  • Help plan cluster growth, capacity allocation, upgrades, and lifecycle management
  • Contribute to a thoughtful reliability culture through documentation, post-incident learning, and pragmatic engineering standards

Minimum Qualifications

  • 4+ years of experience in site reliability engineering, infrastructure engineering, systems engineering, or a related production-operations role
  • Strong hands-on expertise in at least one of the following:
  • Networking, including firewalls, switching, routing, ASN/BGP configuration, or InfiniBand
  • Cluster and systems allocation with Kubernetes, SLURM, MAAS, or similar platforms
  • Distributed storage, particularly Ceph
  • GPU and server administration, including CUDA drivers, firmware, BIOS, and hardware troubleshooting
  • AI training or model-serving infrastructure
  • Experience operating production systems with a focus on availability, performance, security, and automation
  • Strong Linux administration and scripting skills
  • A systematic approach to troubleshooting across multiple layers of a complex system
  • Clear written and verbal communication skills, including the ability to work effectively with a distributed team

Preferred Qualifications

  • Experience supporting GPU-intensive AI or HPC environments
  • Experience with NVIDIA GPUs, CUDA, NCCL, and high-performance interconnects - Experience with InfiniBand, RDMA, RoCE, or 100Gb+ Ethernet
  • Familiarity with Kubernetes, SLURM, MAAS, Terraform, Ansible, or similar infrastructure tooling
  • Experience operating or tuning Ceph clusters
  • Familiarity with observability tooling such as Prometheus, Grafana, and centralized logging systems
  • Experience with hardware provisioning, firmware management, and bare-metal automation
  • Experience running large-scale distributed training or high-throughput inference workloads
  • Familiarity with cloud and hybrid infrastructure across AWS, GCP, or Azure

Boson AI is building AI systems for real-world, business-critical use. If you enjoy solving difficult infrastructure problems and want your work to directly enable the next generation of AI products, we’d love to hear from you.
 
Boson AI uses artificial intelligence (AI) to help screen and assess applications for this position, and our team reviews the shortlisted candidates.

Boson AI Toronto, Ontario, CAN Office

Toronto, Canada

Similar Jobs

8 Days Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead Samsara’s AI initiatives across the software development lifecycle, including developer agents and SRE AI. Manage five to ten senior engineers, set technical direction without an established roadmap, evaluate build-versus-buy decisions, control AI and infrastructure costs, scale automated incident response, and build trust in actions such as root-cause analysis, severity escalation, and deployment rollbacks. Partner directly with R&D leaders and developers while hiring, mentoring, and developing an inclusive, high-performing team.
Top Skills: Ai AgentsClaudeCloud InfrastructureCodexIotModel Context Protocol (Mcp)Sre Automation
9 Days Ago
In-Office or Remote
Canada
Entry level
Entry level
Aerospace • Hardware • Robotics • Software
Own and evolve a portable data platform infrastructure across commercial cloud, government cloud, and on-premises environments. Responsibilities include infrastructure as code, security and compliance, observability, SLOs, incident response, capacity planning, backups, upgrades, deployment tooling, and runbooks. The role will establish SRE practices, support regulated customer deployments, collaborate with distributed systems engineers, and mentor a future SRE hire.
Top Skills: Aws GovcloudCi/CdKubernetesTerraform
17 Days Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Provides staff-level technical leadership for reliability, availability, scalability, security, and performance of a regulated cloud environment. Leads incident response, root-cause analysis, automation, observability, Kubernetes and Linux operations, database and networking troubleshooting, architecture reviews, and cross-functional reliability initiatives. Mentors engineers and establishes operational standards across teams while supporting shift-based coverage and on-call rotations.
Top Skills: AnsibleBashDnsGitGoogle Cloud PlatformJavaScriptKubernetesLinuxMariadbMySQLPostgresPuppetPythonTcp/Ip

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account