Train and operate machine learning models on Amazon SageMaker using AWS Trainium. Develop and optimize PyTorch training code for NeuronCore hardware, diagnose device and compiler issues, tune distributed workloads for throughput and cost, and deliver production training pipelines while collaborating directly with client and engineering teams.
Robots & Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work forward-deployed, embedded directly with client teams, solving the problems that are too new or too specialized for a typical vendor relationship to handle.
The Role
We're looking for an engineer who can operate and train models on Amazon SageMaker running on AWS Trainium, AWS's custom silicon built specifically for large-scale model training. This isn't a role where you call an API and wait. You'll be walking up the stack: understanding what a training request actually looks like at the Trainium hardware and compiler level, then carrying that understanding all the way up through PyTorch training code and into a production SageMaker pipeline.
PyTorch is the backbone of this work. If you know the framework deeply and you're comfortable reasoning about how your code actually behaves on custom accelerator hardware rather than treating it as a black box, this role is built around that skill set specifically.
What You'll Do
- Train and operate models on Amazon SageMaker with AWS Trainium as the underlying compute
- Write and optimize PyTorch training code with a real understanding of how it compiles and executes on Trainium (NeuronCore architecture, compiler behavior, memory and throughput tradeoffs)
- Diagnose training run issues that show up specifically because of the hardware, not just the model, distinguishing a data or code problem from a compiler or device-level one
- Translate a request for "a Trainium job" into an actual working, cost-aware training pipeline, end to end
- Tune distributed training runs for throughput and cost on SageMaker's training infrastructure
- Work directly with client and internal engineering teams to scope and deliver real production training workloads, not experiments that stay in a notebook
What You'll Bring
- Strong, hands-on PyTorch experience, ideally including distributed or multi-device training
- Production experience with Amazon SageMaker for training and/or inference
- Comfort working close to the hardware layer: you understand device-specific compilation and can debug issues that are actually about the accelerator, not just the model
- AWS Trainium or Inferentia (Neuron SDK) experience is a strong plus; if you don't have it yet but have deep PyTorch and a track record of picking up new hardware targets fast, we want to talk to you
- Solid Python fundamentals and comfort operating in a client-facing, production engineering environment
Similar Jobs
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Designs, implements, optimizes, and maintains advanced game AI systems for believable NPC behavior in an AAA production. Responsibilities include behavior trees, navigation, perception, decision-making, debugging, profiling, performance optimization, gameplay integration, technical direction, code reviews, and mentoring junior programmers. The role collaborates with design, animation, gameplay, and systems teams and requires strong C++ programming and game engine experience.
Top Skills:
Behavior TreesC++GitPathfindingPerforceProprietary Game EnginesSensory FrameworksState MachinesUnityUnreal EngineUtility Systems
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Leads production across multiple external game-development teams for an interactive entertainment portfolio. Manages plans, milestones, budgets, risks, dependencies, review gates, publishing workflows, launches, and post-launch support. Partners with creative, product, engineering, legal, and business teams while improving external-development processes and scaling production operations. Requires extensive video game production experience, UGC or creator ecosystem familiarity, and strong cross-functional leadership.
Top Skills:
Live-Service Game PlatformsUgc PlatformsUnreal Engine
Cloud • Security • Software • Cybersecurity • Automation
Leads regional candidate experience operations, including interview coordination, offers, contracts, background checks, onboarding handoffs, workload balancing, escalations, and specialist development. Builds candidate experience reporting, identifies process risks and bottlenecks, standardizes global coordination processes, and partners with recruiting, hiring managers, People Operations, IT, and talent leadership across time zones.
Top Skills:
Applicant Tracking Systems (Ats)GitlabGoogle WorkspaceGreenhouseModernloop
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
