Boson AI Logo

Boson AI

Site Reliability Engineer, AI/ML Infrastructure

Posted 4 Days Ago
Be an Early Applicant
In-Office
Toronto, ON
Senior level
In-Office
Toronto, ON
Senior level
The Senior Site Reliability Engineer will manage HPC infrastructure, optimize cluster operations, and develop automation, ensuring smooth operations and supporting research teams.
The summary above was generated by AI
About The Role

We're looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.

You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale.

Responsibilities

  • Manage and optimize HPC cluster operations
  • Deploy and maintain infrastructure-as-code solutions
  • Support ML/research teams with cluster usage optimization
  • Operate, troubleshoot and optimize Ceph storage clusters.
  • Develop automation and tooling

Minimum Qualifications

  • 5+ years of experience in SRE or HPC operations.
  • Proficiency in Linux systems administration (Ubuntu/Debian).
  • Experience with Kubernetes and container orchestration
  • Experience with Ceph >1PB deployments and maintenance
  • Knowledge of security best practices in multi-tenant environments.
  • Understanding of L2/L3 networking fundamentals
  • Skilled in Python and Bash scripting.

Preferred Qualifications

  • Experience with infrastructure-as-code tools (Ansible/Terraform).
  • Experience with GitOps (Helm, ArgoCD).
  • Strong grasp of RDMA, InfiniBand, and GPUDirect technologies
  • Familiarity with deep learning frameworks such as PyTorch and TensorFlow.
  • Familiarity in at least one cloud platform: AWS, Azure or GCP.

If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.

Top Skills

Ansible
AWS
Azure
Bash
Ceph
GCP
Gitops
Kubernetes
Linux
Python
PyTorch
TensorFlow
Terraform

Boson AI Toronto, Ontario, CAN Office

Toronto, Canada

Similar Jobs

5 Hours Ago
Remote or Hybrid
ON, CAN
Expert/Leader
Expert/Leader
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Principal Engineer at CrowdStrike, you will lead cloud security initiatives, architect scalable data systems, and mentor engineering teams while driving technical vision and strategy for the xspm product.
Top Skills: AWSAzureCassandraETLGCPGoKafkaOpensearchPostgressPythonRedisRestful Apis
15 Hours Ago
Hybrid
2 Locations
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
The Senior Named Account Executive will drive sales and maintain relationships with large Canadian accounts, develop strategies, and manage contract negotiations.
Top Skills: IaasNetworkingPaasSecurity
Yesterday
Remote or Hybrid
5 Locations
Mid level
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Join CrowdStrike as a UI engineer to build an advanced data visualization framework, collaborating with interdisciplinary teams and enhancing user experiences in cybersecurity.
Top Skills: AmchartsAngularCi/CdCSSD3.JsEmberEmber CliGraphQLHighchartsHTMLJavaScriptLitNode/NpmReactResponsive UiRestful ApiTailwindTypescriptWebpack

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account