Boson AI is a startup building large language tools for everyone to use. Our founders (Alex Smola, Mu Li), and a team of Deep Learning, Optimization, NLP, AutoML and Statistics scientists and engineers are working on high quality generative AI models for language, audio, and entertainment.
About The Role
We are looking for a Senior Software Engineer with deep expertise in managing Ceph for our deep learning datacenter in Toronto. The ideal candidate needs to have strong problem solving skills and an ability to learn new tools. Experience with Slurm, MAAS, Infiniband, NVIDIA deepops, Layer 3 networking and related tools are a big plus. You should be comfortable performing some amount of hardware configuration.
You will have the opportunity to work with NVIDIA H100 and A100 GPUs, over 25PB of disk and over 5PB flash storage, Terabit networking and hundreds of computers. You will be responsible for deploying and operating Ceph and its integration with a broad range of infrastructure technologies and hardware systems.
You MUST have prior Ceph experience in order to qualify for the job. If you don't, please don't spam the ATS.
A day in the life:
- Design, manage and maintain large storage arrays
- Integrate them with Deep Learning infrasturcture
- Support troubleshooting for MAAS, Slurm and Kubernetes as needed
- Configure and automate on-premises Linux-based systems at scale using infrastructure-as-code practices
- Learn about new tools and deploy them
You might be a great fit if you have:
- Strong background in maintaining Ceph clusters
- Experience with high performance computing is highly desirable
- Experience with with on-premises Data Center operations and technologies
- Experience in managing a large hardware cluster
- Proficiency in at least one programming language (e.g. Python) and ability to write clean, maintainable code
- Experience with managing firmware / systems updates for systems, e.g. on SuperMicro
The ability to solve problems and to learn new techniques is key.
Top Skills
Boson AI Toronto, Ontario, CAN Office
Toronto, Canada
