Senior Software Engineer - Compiler

Posted 17 Days Ago
Be an Early Applicant
Toronto, ON
Hybrid
5-7 Years Experience
Machine Learning • Software
The Role
Join our team as a Senior Software Engineer - Compiler and help optimize our next generation of inference and training frameworks. You will work on profiling, optimizing, and testing GPU kernels. Strong coding skills in Python and C++ are required, along with a solid foundation in computer science and engineering.
Summary Generated by Built In

About Us

We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.


Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.


Overview:

Do you want to help drive the development of high-performance, power-efficient datacenter solutions for Deep Learning? Do you have an interest in how system architecture across GPU, networking, CPU and IO relate to brand new generative AI capabilities? Come join our team, and bring your experience and interests to help us optimize our next generation of inference and training frameworks/frameworks and to redefine the deep learning industry once again.


Responsibilities:

  • Communicate with our product teams and profile ML/DL workloads to acquire an in-depth understanding of the problems (e.g., slow kernels).
  • Figure out where the bottleneck of the slow GPU kernels with profilers
  • Optimize the GPU kernels.
  • Write tests and benchmarks to validate and evaluate our solutions.

Who you are:

  • Bachelors or higher degree in Computer Science or Engineering.
  • Excellent communication skills and the ability to work in a team.
  • Strong coding skills (in at least one of Python and C++).
  • Solid fundamentals in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc.
  • Strong academic records for candidates with bachelor’s degrees.

You will stand out from the crowd if you have:

  • 5+ years of experience in researching or contributing to HPC/ML/DL systems, frameworks or libraries (including the time of being a graduate student).
  • Experience with GPU architecture and GPGPU programming:
  • NVIDIA GPUs: CUDA programming and libraries and toolkits (e.g., cuDNN, cuBLAS, CUTLASS, nvprof, Nsight Compute, Nsight Systems, etc.);
  • AMD GPUs: ROCm and its related libraries and toolkits.
  • OpenCL
  • Experience with developing high-performance kernels for CPUs.
  • Experience in developing ML or traditional compilers.
  • Experience with TPU.
  • Strong publication records in top HPC/ML/DL or computer system and architecture venues.

Benefits & Perks

- An open and inclusive work environment

- Employee stock options

- Best-in-class medical and dental benefits

- Parental Leave top-up for 6 months

- Professional development budget

- Flexible vacation time to promote a healthy work-life blend


We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. 


CentML strives to respect the dignity and ‎‎independence of people with disabilities and is committed to giving them the same ‎‎opportunity to succeed as all other employees. 


Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.

Top Skills

C++
Python
The Company
HQ: Toronto, Ontario
34 Employees
On-site Workplace
Year Founded: 2022

What We Do

We offer an optimization platform for ML Training. Using our platform, you significantly save on your training costs for small and gigantic models.

Jobs at Similar Companies

SharkNinja Logo SharkNinja

Environmental Manager

Beauty • Robotics • Design • Appliances • Manufacturing
Easy Apply
London, Greater London, England, GBR
3600 Employees

SharkNinja Logo SharkNinja

Senior Marketing Communications Insight Manager

Beauty • Robotics • Design • Appliances • Manufacturing
Easy Apply
London, Greater London, England, GBR
3600 Employees

SharkNinja Logo SharkNinja

eCommerce IT Operations Coordinator

Beauty • Robotics • Design • Appliances • Manufacturing
Easy Apply
London, Greater London, England, GBR
3600 Employees

Verkada Inc Logo Verkada Inc

Enterprise Development Representative - DACH

Cloud • Hardware • Security • Software
London, Greater London, England, GBR
2000 Employees

Similar Companies Hiring

Instacart Thumbnail
Software • Retail • Food • eCommerce
San Francisco, CA
3000 Employees
Toast Thumbnail
Software • Information Technology • Hospitality • Food • Fintech • Cloud
Boston, MA
4500 Employees
Block Thumbnail
Software • Payments • Fintech • Financial Services • eCommerce • Cryptocurrency • Blockchain
Oakland, CA
12000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account