xAI Logo

xAI

AI Engineer & Researcher - Pre-training and Scaling

Posted 5 Days Ago
2 Locations
Entry level
2 Locations
Entry level
The AI Engineer & Researcher at xAI focuses on training trillion parameter neural networks, optimizing GPU utilization, innovating inference stack, implementing state-of-the-art methods, and developing AI systems to understand the universe.
The summary above was generated by AI

About xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.

Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. Engineers are encouraged to work across multiple areas of the company, and as a result, all engineers and researchers share the title "Member of Technical Staff."

We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important.

All engineers and researchers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

xAI does not have recruiters. Every application is reviewed directly by a technical member of the team.

Tech Stack

  • Python / Rust / C++
  • JAX and XLA
  • NCCL
  • CUDA (C++ and Triton)

Location

The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.

Focus

  • Training trillion parameter neural networks at scale, as well as a variety of smaller specialized models.
  • Rapidly implementing the latest state-of-the-art methods from the deep learning literature.
  • Innovating new ideas for pre-training and new scaling paradigm.

Ideal Experiences

  • Expert in machine learning and large model scaling, familiar with all kinds of scaling laws.
  • Good at understanding training through careful ablations.
  • Experience in optimizing model training efficiency.
  • Familiar with distributed training and parallelism strategies.

Interview Process

After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15-minute interview (“phone interview”) during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process, which consists of four technical interviews:

  1. Coding assessment in a language of your choice.
  2. Systems hands-on: Demonstrate practical skills in a live problem-solving session.
  3. Project deep-dive: Present your past exceptional work to a small audience.
  4. Meet and greet with the wider team.

Our goal is to finish the main process within one week. We don’t rely on recruiters for assessments. Every application is reviewed by a member of our technical team. All interviews will be conducted via Google Meet.

Annual Salary Range

$180,000 - $440,000 USD

California Consumer Privacy Act (CCPA) Notice

Top Skills

C++
Python
Rust

Similar Jobs

Be an Early Applicant
2 Hours Ago
Pleasanton, CA, USA
Hybrid
1,810 Employees
Senior level
1,810 Employees
Senior level
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Senior Site Reliability Engineer ensures optimal performance and availability of BlackLine's cloud services by managing capacity planning, technical project execution, and software engineering tasks. Responsibilities include collaborating with teams, addressing customer escalations, identifying and resolving performance issues, and developing automation tools to enhance service reliability and efficiency.
Be an Early Applicant
2 Hours Ago
Pleasanton, CA, USA
Hybrid
1,810 Employees
Senior level
1,810 Employees
Senior level
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Staff Site Reliability Engineer at BlackLine will assess and report on the performance and availability of production applications, create testing frameworks, and develop capacity plans. Responsibilities include optimizing the service experience, automating event identification, establishing KPIs, and mentoring team members. The role requires collaboration across functions and a commitment to continuous learning in a dynamic environment.
Be an Early Applicant
2 Hours Ago
Pleasanton, CA, USA
Hybrid
1,810 Employees
Senior level
1,810 Employees
Senior level
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Senior Manager, Site Reliability Engineering will lead a team overseeing the FedRamp operations and reliability of BlackLine's Multi-Tenant Accounts Receivable SaaS products hosted in Microsoft Azure. Responsibilities include capacity planning, performance monitoring, incident response, and managing day-to-day operations.

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account