Inference Infrastructure Engineer Jobs

1 job found

Today

Software Engineer, ML Accelerators

DeepMind San Francisco, CA

San Francisco, CA

Today

$174k - $252k/yr Full time Ai Accelerators Engineering Hardware Acceleration

Apply Now

Job Description

Build the software foundation for next-generation AI inference at DeepMind. This onsite Software Engineer role in San Francisco focuses on the ML compiler stack and inference infrastructure that powers a next-generation compute platform, with an emphasis on HW acceleration and SW/HW codesign. You will join a team of scientists and engineers working on technology that helps shape the future of machine learning for Google and the broader industry.

As part of a highly collaborative environment, you will contribute to performance-critical systems that bridge AI workloads with low-level hardware operators. If you enjoy taking initiative and shipping end-to-end improvements across the stack, this coding role supports that drive.

Responsibilities

Own a direct full-stack software role focused on the ML compiler and inference infrastructure.
Design and develop an ML compiler stack that connects AI workloads to low-level hardware operators.
Design and build software infrastructure to enable high-performance inference.
Lead SW/HW codesign, including kernel optimization, performance tuning, and debugging.

Requirements

Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
Experience developing software with Python and C++.
Experience with ML hardware accelerators, ML compiler stacks (examples include JAX, PyTorch, XLA), and kernel development.

Preferred Qualifications

PhD degree in Computer Engineering, Computer Science, or a related field.
2 years of experience in full-stack system development for hardware accelerators.
2 years of experience with collaborative, hyper-scalar software development and engineering best practices.
Experience scoping, planning, and executing projects toward team goals in ambiguous environments.

Key Technologies

Python, C++, JAX, PyTorch, XLA

Compensation and Benefits

US compensation range: $174,000 - $252,000 USD per year, plus a 15% bonus target, equity, and benefits.

DeepMind is an AI lab with exceptional interdisciplinary teams focused on advancing AI development, supporting safety and ethics as top priorities. The organization emphasizes learning opportunities and varied career pathways, with global teams working to deliver high-quality impact and innovation for billions of users.

View full job page →

Get Inference Infrastructure Engineer Jobs alerts

New Inference Infrastructure Engineer Jobs, daily.