Baseten Logo

Baseten

Software Engineer - Testing Frameworks

Posted 12 Days Ago
Hybrid
Toronto, ON, CAN
Entry level
Hybrid
Toronto, ON, CAN
Entry level
Build and own Baseten’s testing platform, including unit, integration, load, performance, resilience, and chaos testing frameworks. Develop ephemeral Kubernetes environments, dependency provisioning, CI optimization, test reliability tooling, observability, coverage dashboards, and shared test libraries. Partner with infrastructure and product teams, establish testing standards, improve engineering practices, and mentor colleagues.
The summary above was generated by AI

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

Baseten is seeking talented and experienced Software Engineers to join our Platform team within the Infrastructure organization. As a member of Baseten's Platform Team, you will own the systems that let every engineer at Baseten prove their code works before it reaches production. Our product runs mission-critical AI inference for customers who measure downtime in dollars per second, which means our internal bar for correctness, performance, and failure tolerance has to be exceptional.

Your focus is the full testing stack: fast and reliable unit test tooling, integration harnesses that spin up realistic environments on demand, load and performance testing for GPU-backed inference workloads, and resilience testing that deliberately breaks things so our customers never have to find out what happens when a node dies mid-request. This is a builder role with org-wide leverage. You won't be writing tests for other teams — you'll be building the frameworks, harnesses, and feedback loops that make writing good tests the path of least resistance, and you'll set the standards for what "well-tested" means at Baseten.

RESPONSIBILITIES

  • Own Baseten's testing strategy end to end — define the standards, the tiers, and the tooling that engineering teams build against.

  • Build and maintain unit, integration, load and performance testing frameworks

  • Design end to end test infrastructure that provisions realistic dependencies on demand — ephemeral Kubernetes namespaces, containerized service dependencies, etc.

  • Build resilience and chaos testing capabilities: fault injection, network partition and latency simulation, pod and node failure scenarios, dependency degradation, and automated verification that our systems degrade gracefully and recover.

  • Attack test suite reliability head-on — flake detection and quarantine, test impact analysis and selective execution, parallelization, and aggressive reduction of end-to-end CI wall time.

  • Build observability into the testing layer itself: coverage reporting, test health dashboards, failure triage tooling, and clear signals about which areas of the codebase are under-tested.

  • Create project templates and shared libraries so new services start with a complete testing setup on day one.

  • Partner directly with product and infrastructure teams — embed where needed, understand their hardest testing problems, and turn one-off solutions into platform capabilities.

  • Mentor engineers across the org on testing practice and raise the collective bar through code review, documentation, and internal advocacy.

REQUIREMENTS

  • Strong proficiency in Go and/or Python, with hands-on experience building test tooling and libraries used by other engineers.

  • Deep experience with testing frameworks and their internals — pytest, Go's testing package, testify, testcontainers, or equivalents — including the ability to extend them, not just use them.

  • Experience designing integration test infrastructure for distributed systems, including ephemeral environment provisioning and dependency management.

  • Practical experience with load and performance testing tools (k6, Locust, Vegeta, JMeter, Gatling, or similar) and the judgment to interpret results and drive action from them.

  • Solid Kubernetes and Docker fundamentals — you can build test infrastructure that runs on and tests against real cluster environments.

  • Advanced understanding of CI/CD, including how to keep large test suites fast, deterministic, and trustworthy at scale.

  • A track record of measurably improving testing culture on an engineering team — you have opinions on what to test, what not to test, and where the ROI actually is.

  • Are excited about building foundational infrastructure and are comfortable working independently on ambiguous, high-impact technical challenges

BENEFITS

  • Competitive compensation, including meaningful equity

  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • (U.S. only) Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Similar Jobs

26 Minutes Ago
Hybrid
Toronto, ON, CAN
Expert/Leader
Expert/Leader
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead technology risk and governance across five enterprise technology asset management transformation workstreams for a major Canadian bank. Responsibilities include risk assessments, control design and testing, audit evidence management, regulatory remediation, governance reporting, issue escalation, and remediation tracking. The role partners with architects, information security teams, technology leaders, risk functions, and delivery partners to embed effective controls and ensure compliance with enterprise policies, security standards, and regulatory expectations.
Top Skills: ArcherCgeitCobitGovernance Risk And ComplianceIso 27001Itil 4Servicenow Integrated Risk Management
26 Minutes Ago
Hybrid
Toronto, ON, CAN
Expert/Leader
Expert/Leader
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Leads organizational change and Build-Operate-Transfer activities across five enterprise technology asset management workstreams. Develops change strategies, stakeholder plans, impact assessments, communications, training, SOPs, runbooks, knowledge-transfer plans and readiness evaluations. Supports adoption of ServiceNow, CMDB and technology asset lifecycle management capabilities, partnering with senior stakeholders and delivery teams to embed sustainable operating models and transition capabilities into business-as-usual operations within a major Canadian financial institution.
Top Skills: Configuration Management Database (Cmdb)Itil 4SafeServicenowTechnology Asset Lifecycle Management (Talm)
26 Minutes Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead integrated delivery of a five-workstream Enterprise Technology Asset Management transformation for a Tier 1 Canadian bank. Manage governance, risks, issues, dependencies, resources, milestones, executive reporting, financials, vendor performance, and delivery commitments. Serve as the primary client contact, align senior stakeholders and distributed technology teams, resolve delivery challenges, and translate strategy into measurable outcomes across Agile, Waterfall, and hybrid environments.
Top Skills: AgileHybrid DeliveryServicenowWaterfall

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account