Huawei Canada Logo

Huawei Canada

Principal Software Engineer - Cloud AI Infrastructure

Posted Yesterday
Be an Early Applicant
In-Office
Markham, ON, CAN
Senior level
In-Office
Markham, ON, CAN
Senior level
The Principal Software Engineer will integrate AI frameworks with cloud infrastructure to enhance performance and reliability, develop prototypes, and collaborate closely with the product team to meet constraints and requirements.
The summary above was generated by AI

Huawei Canada has an immediate permanent opening for a Principal Engineer.

About the team:

Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, infrastructure resource scheduling and prediction, cloud-native middleware, media engines, and user experience studies. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform. Our team has an immediate permanent opening for a Principal Software Engineer.

About the job:

  • Integrate AI frameworks with cloud infrastructure to optimize end-to-end architecture for AI inference and fine-tuning scenarios. Focus on improving the observability, reliability, and performance of AI services.

  • Collaborate with team members to design and develop concept prototypes. Conduct validation of optimization strategies to ensure effectiveness.

  • Work closely with the product team to support the development of prototypes, taking into account the constraints and requirements of the product's current status.

About the ideal candidate:

  • 5 years of software development experience, with a minimum of 2 years of experience in AI infrastructure-related platform R&D for fine-tuning or inference, including but not limited to AI workload profiling tools development, vLLM or SGLang development, infrastructure level troubleshooting and root cause analysis.

  • Proficiency in Golang or Rust. Must be able to write clean, efficient, and high-quality code from scratch.

  • In-depth understanding of AI technologies and familiarity with the module interactions involved in AI model training, inference framework and storage system.

  • Proficient in Kubernetes or Ray, with practical experience in developing services based on these platforms.

  • Strong understanding of cloud services and platforms such as AWS and Azure.

  • Highly analytical, with strong problem-solving skills and the ability to address complex technical challenges effectively.

  • Self-driven, with a proven ability to learn quickly and take initiative.

  • Master's or Ph.D. degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Top Skills

AWS
Azure
Go
Kubernetes
Ray
Rust
HQ

Huawei Canada Markham, Ontario, CAN Office

19 Allstate Pky, Markham, Ontario, Canada, L3R 5A4

Similar Jobs

2 Hours Ago
Remote or Hybrid
Canada
Senior level
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Lead design and implementation of cloud-native payment systems using TypeScript/React/Node.js. Collaborate with cross-functional Agile teams, optimize for performance and reliability, mentor junior engineers, drive architectural decisions, and build on GCP with Kubernetes and PostgreSQL.
Top Skills: ConfluenceDockerGCPGitJIRAKubernetesNode.jsPostgresReactRest ApisTypescript
5 Hours Ago
Easy Apply
Remote or Hybrid
Toronto, ON, CAN
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Major Account Executive will drive customer engagement from prospecting to closing, build relationships, and manage large, complex sales with a focus on sustainability and technology solutions.
Top Skills: SaaS
5 Hours Ago
Hybrid
Toronto, ON, CAN
Junior
Junior
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
The Sales Support Associate enhances customer experience through personalized service, manages store operations, and supports sales activities while maintaining housekeeping standards.
Top Skills: IpadLaptopMobile PosPos Systems

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account