Trainium

Trainium Engineer Jobs

2 jobs found

1mo ago

Software Engineer- AI/ML, AWS Neuron Distributed Training - Performance Optimization

Annapurna Labs (U.S.) Inc. Cupertino, CA

Cupertino, CA

1mo ago Closed

$144k - $194k/yr Full time AWS Aws Neuron Cloud

This position is no longer accepting applications (closed Jul 21, 2026).

Job Description

Software Engineer on the AWS Neuron Distributed Training team focused on performance optimization for distributed training on Trainium, collaborating with PyTorch, JAX, and Neuron compiler/runtime to improve throughput and efficiency for large-scale models.

Location and compensation details: Cupertino, CA onsite. Salary range of USD 143,700 to 194,400 per year. Minimum experience: 3+ years. Education: Bachelor's degree in computer science or equivalent.

Responsibilities

Lead efforts to optimize distributed training performance on Trainium, with a primary focus on maximizing training throughput, model FLOPs utilization, and overall efficiency across the Neuron software stack.
Collaborate across PyTorch, JAX, and the Neuron compiler and runtime to enable and tune large-scale training workloads on the latest Trainium instances.

Requirements

3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture experience (design patterns, reliability, and scaling) of new and existing systems
Experience programming with at least one software programming language
3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
Bachelor's degree in computer science or equivalent

Technologies

PyTorch
JAX
AWS Neuron
Neuron compiler
Neuron runtime
Trainium
Trn3/Trn2/Trn1
Inf2/Inf1 servers

Benefits

Health insurance
401(k) matching
Paid time off
Parental leave
Sign-on payments
Restricted stock units (RSUs)
Basic Life & AD&D insurance
Supplemental life plans
Employee Assistance Program (EAP)
Mental health support
Medical advice line
Flexible Spending Accounts
Adoption and surrogacy reimbursement coverage

View full job page →

1mo ago

Software Engineer I - AI/ML, AWS Neuron Distributed Training

Annapurna Labs (U.S.) Inc. Cupertino, CA

Cupertino, CA

1mo ago Closed

$127k - $185k/yr Full time AWS Aws Neuron Cloud

This position is no longer accepting applications (closed Jul 7, 2026).

Job Description

Annapurna Labs (U.S.) Inc. is seeking a Software Engineer I with a focus on AI/ML distributed training. The role centers on optimizing large-scale models for AWS Trainium, implementing mixed-precision strategies, and extending training frameworks within the Neuron ecosystem, in collaboration with hardware and AWS teams. This is an onsite position based in Cupertino, CA, offering a compensation range of USD 127,100 to 185,000 per year.

Responsibilities

Contribute to designing and implementing distributed training solutions for large-scale ML models running on Trainium instances.
Extend and optimize popular distributed training frameworks within the Neuron ecosystem, including FSDP, torchtitan, and Hugging Face libraries.
Develop and optimize mixed-precision and low-precision training techniques, covering BF16, FP8, and emerging formats to boost throughput while preserving accuracy and convergence quality.
Implement precision-aware training strategies, loss scaling, and careful gradient management to ensure stability across reduced-precision formats.
Profile, analyze, and tune end-to-end training pipelines to achieve optimal performance on Trainium hardware.
Collaborate with hardware, compiler, and runtime teams to understand system constraints and unlock new capabilities.
Partner with AWS solution architects and customers to support the deployment and optimization of training workloads at scale.

Requirements

Bachelor's degree or higher in computer science, computer engineering, or a related field (or equivalent bachelor's degree).
1+ years of programming experience in at least one software language, including academic projects, internships, or research.
Experience with software development practices such as code reviews, source control, testing, and build processes.
Experience with machine learning concepts and at least one ML framework (PyTorch, JAX, or TensorFlow).

Technologies

FSDP
torchtitan
Hugging Face libraries
PyTorch
JAX
TensorFlow
Trainium
AWS Neuron
BF16
FP8

Benefits

Health insurance
401(k) matching
Paid time off
Parental leave
Sign-on payments
Restricted stock units (RSUs)
Flexible Spending Accounts
Employee Assistance Program (EAP)
Mental Health Support
Adoption and Surrogacy Reimbursement

View full job page →

Trainium Engineer Jobs

Software Engineer- AI/ML, AWS Neuron Distributed Training - Performance Optimization

Software Engineer I - AI/ML, AWS Neuron Distributed Training

Get Trainium Engineer Jobs alerts