RunPod is pioneering the future of AI and machine learning, offering cutting-edge cloud infrastructure for full-stack AI applications. Founded in 2022, we are a rapidly growing, well-funded company with a remote-first organization spread globally. Our mission is to empower innovators and enterprises to unlock AI's true potential, driving technology and transforming industries. Join us as we shape the future of AI.
We are seeking an experienced and visionary Site Reliability Engineering (SRE) Manager to lead and mentor our team of highly skilled Site Reliability Engineers. The ideal candidate will have a strong technical background in SRE practices, excellent leadership skills, and the ability to drive our organization's reliability and scalability initiatives forward.
As the SRE Manager, you will be responsible for overseeing the design, implementation, and maintenance of our large-scale, distributed systems across multiple data centers. You will lead a team that manages our critical infrastructure, including our GPU/AI technologies, and ensure the continuous improvement of our systems' reliability, performance, and security.
Our SRE Philosophy
- Automation First: We prioritize automating all aspects of our infrastructure to enable rapid, consistent, and reliable scaling.
- Systems Thinking: We approach problems holistically, considering the entire system's health and performance.
- Continuous Improvement: We constantly iterate on our processes, tools, and systems using data-driven decision-making.
- Proactive Problem Solving: We build systems and tools that anticipate and mitigate potential issues before they occur.
- Scalability Through Code: We manage our infrastructure as code, applying software engineering best practices to our infrastructure configurations.
As the SRE Manager, you will be instrumental in reinforcing these principles and evolving our SRE practices to meet the challenges of our rapidly growing organization.
If you are passionate about leading a team of top-tier SREs, driving technical excellence, and solving complex infrastructure challenges at scale, we want to hear from you. Join us in shaping the future of AI compute infrastructure and building highly reliable, scalable systems that power cutting-edge technologies.
Responsibilities:
- Lead and mentor a team of Site Reliability Engineers, fostering a culture of innovation, continuous learning, and technical excellence
- Develop and implement strategic plans to enhance the reliability, scalability, and efficiency of our infrastructure
- Collaborate with cross-functional teams to align SRE initiatives with broader organizational goals
- Establish and maintain SLIs, SLOs, and SLAs for critical systems and services
- Drive the adoption of best practices in automation, monitoring, and incident response
- Oversee the management and optimization of large-scale bare-metal fleets across multiple data centers
- Ensure the implementation and maintenance of robust security practices throughout our infrastructure
- Manage on-call rotations and escalations, providing leadership during critical incidents
- Contribute to capacity planning and resource allocation for infrastructure growth
- Develop and track key performance indicators (KPIs) for the SRE team and infrastructure health
- Participate in hiring and team growth initiatives to build a world-class SRE organization
Requirements:
- 5+ years of experience in Site Reliability Engineering or a similar role
- 3+ years of experience in a technical leadership or management position
- Deep understanding of Linux systems, containerization, virtualization, and networking technologies
- Strong background in managing and monitoring large-scale distributed systems and bare-metal fleets
- Expertise in infrastructure-as-code and configuration management tools
- Proficiency in at least one programming language, preferably Python or Golang
- Experience with cloud platforms (AWS, GCP, Azure) and their respective services
- Strong knowledge of monitoring, observability, and alerting systems
- Excellent problem-solving skills and ability to manage complex, large-scale incidents
- Proven track record of implementing and managing SLIs, SLOs, and SLAs
- Strong communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders
- Successful completion of a background check
Preferred:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- Experience managing teams working with GPU compute resources at scale
- Familiarity with AI/ML infrastructure and workloads
- Relevant industry certifications (e.g., AWS Certified DevOps Engineer - Professional, Certified Kubernetes Administrator)
- Experience with cost optimization and efficiency improvements in large-scale infrastructure
- Track record of contributing to open-source projects or speaking at industry conferences
What You’ll Receive:
- The competitive base pay for this position ranges from $180,000 - $210,000. Factors that may be used to determine your actual pay may include your specific job related knowledge, skills and experience
- Stock options
- The flexibility of remote work with an inclusive, collaborative team.
- An opportunity to grow with a company that values innovation and user-centric design.
- Generous vacation policy to ensure work-life harmony and well-being.
- Contribute to a company with a global impact based in the US, Canada, and Europe.
RunPod is committed to maintaining a workplace free from discrimination and upholding the principles of equality and respect for all individuals. We believe that diversity in all its forms enhances our team. As an equal opportunity employer, RunPod is committed to creating an inclusive workforce at every level. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, protected veteran status, disability status, or any other characteristic protected by law.
