Software Engineer Neuron Containers

Annapurna Labs (U.S.) Inc. is hiring for the Neuron Containers team to help customers run distributed training and inference workloads on AWS Neuron at scale. In this onsite role in Cupertino, CA, you will build and maintain the integrations, tooling, and deployment assets that make Neuron work reliably across modern container and cloud environments.

What you’ll build

• Platform integrations for ML accelerator resource management, including device plugins, DRA drivers, and operators
• Neuron Deep Learning Containers (DLCs) and Deep Learning AMIs (DLAMIs) to support customer deployments on EKS, ECS, EC2, and SageMaker
• Ongoing improvements to integration performance and scalability across large customer clusters

Responsibilities

• Design and implement container platform integrations for Neuron
• Build and maintain DLCs and DLAMIs for customer deployment across EKS, ECS, EC2, and SageMaker
• Diagnose and resolve performance and scalability issues in large customer environments
• Simplify systems by deprecating legacy software and reducing complexity in container delivery pipelines
• Deliver work across the full development lifecycle, including design documentation, implementation, testing, deployment, and operations

What we’re looking for

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience (design patterns, reliability, and scaling) for new and existing systems
• Experience programming with at least one software programming language
• 3+ years across the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Bachelor’s degree in computer science or equivalent
• Experience with distributed systems or large-scale cluster infrastructure
• Familiarity with ML training/inference workflows (distributed training, collective)
• Experience with AWS compute services including EC2, EKS, ECS, ECR
• Hands-on experience with Helm, Prometheus, or Kubernetes operator frameworks
• Experience with container image pipelines, Neuron Deep Learning Containers, or Deep Learning AMIs
• Contributions to open-source projects, particularly in the Kubernetes ecosystem

Technologies you’ll work with

Kubernetes, ECS, Slurm, EKS, EC2, SageMaker, Helm, Prometheus, Kubernetes operator frameworks, ECR, container image pipelines, Neuron Deep Learning Containers (DLCs), Deep Learning AMIs (DLAMIs), device plugins, DRA drivers, operators, distributed systems.

Benefits

• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• Paid time off
• Parental leave

A day in the life

• Work with teams across the Neuron organization and with customers to build and maintain integrations for current and next-generation accelerators
• Participate in architecture reviews, triage test failures, resolve operational issues, and contribute to upstream Kubernetes projects
• Debug platform integration problems, including how Neuron interacts with container runtimes, orchestrators, and scheduling systems at scale

Salary

USD 165,200 - 223,600 per year.

Los Angeles County applicants: job duties

Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some material job duties of this position, including the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, qualified applicants with arrest and conviction records will be considered.