C-Gen.AI Logo

C-Gen.AI

HPC & MLOps Engineer

Posted 11 Days Ago
Remote or Hybrid
Hiring Remotely in CA
Mid level
Remote or Hybrid
Hiring Remotely in CA
Mid level
Design, deploy, and maintain HPC and MLOps infrastructure across cloud and on-prem clusters. Manage schedulers (Slurm/PBS), optimize MPI/CUDA stacks, storage and networking, automate deployments with Python/Bash, instrument systems, and enable AI training/inference pipelines while collaborating with product and support teams.
The summary above was generated by AI
About C-Gen.AI

At C-Gen.AI, we are pioneering the next generation of AI infrastructure. As a leading technology company, our mission is to deliver world-class AI Infrastructure management solutions that drive innovation, efficiency, and performance at scale. We seek passionate, highly skilled engineers who excel in dynamic environments and are eager to work with cutting-edge technologies to transform the computational landscape.

Role Summary

As an HPC & MLOps Engineer, you will be a foundational member of our Data Center team—integral to the design, deployment, and maintenance of high-performance computing (HPC) and MLOps systems. In this role, you will ensure our clients have access to reliable, scalable, and secure HPC environments. You will collaborate closely with cross-functional teams and work under a dynamic, startup environment that rewards initiative and technical excellence.

Key Responsibilities
  • HPC Infrastructure Support:

    • Configure, deploy, monitor, and maintain C-Gen.AI Cluster solution for a diverse client base.

    • Manage both cloud and on-premise deployments, ensuring optimal job scheduling and resource allocation.

    • Troubleshoot and optimize HPC library stacks—including OpenMPI, CUDA, TensorFlow, and PyTorch—and manage parallel file systems (e.g. Lustre, BeeGFS, Ceph, NFS, or object storage).

  • Cloud & On-Prem Automation:

    • Develop and oversee automated deployments across multiple platforms (Cloud providers or on-premise clusters).

    • Implement best practices for network configuration, security, and cost optimization tailored to HPC needs.

    • Create and maintain Bash/Python scripts that streamline workflows, gather essential metrics, and empower self-service HPC management.

  • MLOps Enablement: Contribute to the development and maintenance of HPC workflows for AI/ML teams, enhancing training and inference pipelines.

  • Potential HPC Development:

    • Collaborate with our in-house HPC experts on advanced projects involving performance tuning, MPI, and GPU parallelization.

    • While not mandatory at present, there is ample opportunity to expand your technical skill set in HPC development over time.

  • Reliability & visibility: Instrument systems, collect metrics, and build dashboards/alerts that enable self-service and rapid incident response.

  • Collaboration: Work closely with product, support, and customer teams; document designs, runbooks, and standards

What You Bring
  • Experience: 3+ years hands-on in HPC operations; strong familiarity with Slurm (or similar batch systems such as PBS Pro/OpenPBS).

  • Software skills: Solid Python (including asyncio/task-oriented patterns) and Bash for automation, tooling, and data handling.

  • Scheduling & process management: Deep understanding of batch queues, job lifecycle, and multi-tenant cluster policies.

  • Linux: Strong understanding of RedHat/Debian linux flavors and system administration.

  • Cloud & hybrid: Proficiency with at least one major cloud (AWS/GCP/Azure/OCI) and interest in others; comfortable bridging cloud and on-premises deployments.

  • Storage & performance: Practical knowledge of Lustre/Ceph/NFS/object storage and the throughput/latency trade-offs common to HPC.

  • ML/HPC fluency: Understanding of AI training/inference workflows, GPU scheduling, drivers, and runtime management.

  • Networking: Confidence with high-performance networking (e.g., RDMA/InfiniBand/RoCE) and compiling Linux modules for network support.

  • Communication: Clear written/spoken English; able to collaborate across time zones and functions.

  • Mindset: Self-directed, detail-oriented, and comfortable in a fast-moving startup.

Nice to Have
  • Python libraries & SDKs: asyncio, aiohttp, cloud SDKs (e.g., boto3, google-cloud, azure-sdk, OCI).

  • Performance tuning: CUDA/NCCL profiling, MPI optimization, kernel/sysctl tuning, GPU/CPU/IO benchmarking.

  • Cost optimization: Experience balancing cost, performance, and reliability—especially in cloud bursting scenarios.

  • C/C++ Experience: Having C/C++ and systems programming experience is a big plus.

Why Join C-Gen.AI?
  • High Impact & Growth: Play a crucial role in a startup with unicorn potential, driving innovation at every level.

  • Ownership & Influence: Enjoy significant autonomy with a direct influence on both technical decisions and team culture.

  • Competitive Compensation: Competitive salary, stock options, and flexible remote work arrangements.

  • Mentorship & Learning: Collaborate directly with our technical CEO and an experienced HPC specialist, ensuring continuous professional growth.

  • Culture of Autonomy: Thrive in an environment that values trust, minimal supervision, and individual initiative.

If you’re excited to build the foundation of large-scale AI, we’d love to hear from you. Apply now and help shape the future of AI infrastructure.

Similar Jobs

6 Hours Ago
Easy Apply
Remote
Easy Apply
Senior level
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead regional protective intelligence by owning end-to-end threat case management, conducting structured behavioral threat assessments, coordinating incident response with cross-functional and law enforcement partners, producing decision-ready briefings, and improving regional program maturity through playbooks, QA, training, and mentoring.
Top Skills: Case Management ToolsGenerative AiOnticOsint PlatformsPublic Records ResearchSocial Media Monitoring
10 Hours Ago
In-Office or Remote
Mid level
Mid level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The Account Executive will build a sales pipeline in the German markets, work with cross-functional teams, and maintain stakeholder relationships to drive sales and manage accounts for Deepgram's voice AI platform.
Top Skills: AISales TechnologySpeech-To-SpeechSpeech-To-TextText-To-SpeechVoice Ai
10 Hours Ago
Remote
Mid level
Mid level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Sell Deepgram's voice AI platform across EMEA by prospecting new logos, building pipeline, closing full-cycle technical deals, collaborating with Sales Ops and Sales Engineers, managing stakeholder relationships, and driving upsell with CSMs. Target technical buyers and communicate product value to meet and exceed quotas.
Top Skills: Ai/MlCloud ApisDeveloper ToolsSpeech-To-TextText-To-SpeechVoice Ai

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account