Arena (arena.ai) Logo

Arena (arena.ai)

Software Engineer - ML Infrastructure

Reposted One Month Ago
In-Office or Remote
Hiring Remotely in CA
Senior level
In-Office or Remote
Hiring Remotely in CA
Senior level
Design and develop scalable, high-performance data and API infrastructure for real-time processing. Mentor engineers and collaborate with teams to enhance AI model evaluations.
The summary above was generated by AI
About Arena Intelligence

Arena is the platform for evaluating how AI models perform in the real world. Founded by researchers from UC Berkeley's SkyLab, we're on a mission to measure and advance the frontier of AI for real-world use, and to build the foundation for everyone to understand, shape, and benefit from it.


Tens of millions of people use Arena each month to evaluate how frontier systems handle the work they actually do. The preferences they share power the most transparent, rigorous, and human-centered evaluations in AI. Leading AI labs, enterprises, and independent researchers rely on our work and open datasets to understand how models behave in real workflows: agentic coding, creative generation, professional productivity, and beyond. We go beyond leaderboards and decompose what human experience reveals about AI, so models advance toward the work people actually do.


We're a team of researchers, academics, builders, and creatives from UC Berkeley, Google, Stanford, and DeepMind. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We're building a company where thoughtful, curious people from all backgrounds can do their best work together, in an office culture that radiates excellence, energy, and focus.

About the Role

Arena Intelligence is seeking an ML Infrastructure Software Engineer to lead the design and development of scalable, low-latency model inference infrastructure, high-performance post-training infrastructure for reinforcement learning (RL), distributed ML training job execution, and comprehensive model evaluation frameworks. In this role, you’ll architect systems that execute complex training, inference, and evaluation workloads at scale, powering the insights that help researchers and developers build the world’s most advanced AI models. Working in close partnership with ML researchers, your contributions will be foundational to surfacing trustworthy, transparent, and timely evaluation and training signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that advance state-of-the-art AI capabilities.

You’ll
  • Architect, scale, and optimize LLM post-training infrastructure tailored for reinforcement learning (RL) alongside with low-latency model inference services

  • Design and maintain robust job execution systems for large-scale distributed ML training and fine-tuning workloads

  • Build comprehensive, automated model evaluation frameworks to deliver rapid, reliable feedback signals to ML researchers

  • Ensure high availability, low latency, and fault tolerance across GPU clusters and distributed event streams

  • Collaborate cross-functionally with AI researchers, product leaders, and infrastructure teams to support evolving training and evaluation needs

You’ll have
  • 5+ years of experience in software engineering, with a focused background in ML infrastructure, distributed systems, or large-scale data platform engineering

  • Hands-on experience with PyTorch, model serving engines, and distributed training frameworks

  • Solid background in reinforcement learning (RL) post-training infrastructure, RLHF, or automated model evaluation pipelines

  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant distributed services at scale

  • Strong foundation in systems design, GPU cluster utilization, and performance tuning

  • Thrive in a fast-paced, high-ownership environment working closely with ML researchers

What we offer
  • We offer competitive compensation aligned to the markets where our team members are based. The compensation range for each role is listed on its posting and will depend on the candidate's experience and work location.

  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.

  • The opportunity to work on cutting-edge AI with a small, mission-driven team

  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Similar Jobs

Yesterday
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage enterprise customers after implementation, helping them achieve business value from Samsara’s IoT platform. Develop joint success plans, lead executive business reviews and customer workshops, recommend workflow improvements, explain platform capabilities, resolve barriers, and mentor Customer Success and Support teams. Collaborate with Sales, Support, Sales Engineering, Product, and Engineering while supporting customers across transportation, utilities, field services, and other physical-operation industries.
Top Skills: Internet Of Things (Iot)SaaS
Yesterday
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Fintech • Information Technology • Marketing Tech • Payments • Social Impact • Software
Leads and builds Donorbox’s product marketing function, owning positioning, messaging, product-led growth, launches, enablement, competitive intelligence, and performance measurement. Partners with Product, Sales, Customer Success, and Marketing to drive acquisition, conversion, retention, and expansion. Manages one direct report, establishes scalable processes and KPIs, influences roadmap priorities, and presents data-driven insights to executive leadership.
Top Skills: Product-Led Growth (Plg)SaaS
2 Days Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Junior
Junior
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead and develop a Canada Scaled Customer Success team to drive onboarding, adoption, expansion, and renewals via digital scale programs. Hire and coach CSMs, manage KPIs/OKRs, improve processes and tooling, collaborate cross-functionally, and escalate high-stakes customer moments to ensure measurable customer outcomes.
Top Skills: CRMCs PlatformDigital Engagement ToolsGainsightProduct AnalyticsTotango

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account