Senior Software Engineer

Amazon.com Services LLC is seeking a Senior Software Engineer to lead the design, development, and operation of a next generation AI workload orchestration platform built on Kubernetes. This onsite role in Seattle focuses on enabling scalable ML training and inference across Annapurna Labs' Inferentia and Trainium accelerators, with the opportunity to mentor engineers and collaborate with ML researchers, SDK developers, and hardware teams. The position offers a salary range of USD 168,100 to 227,400 per year.

Responsibilities

• Lead the design, development, and operation of a next-generation AI workload orchestration platform built on Kubernetes, enabling scalable job scheduling, multi-node distributed training, and artifact management across Annapurna Labs' custom ML silicon (Inferentia and Trainium families).
• Drive architectural decisions across the full stack from service APIs and workflow orchestration to cluster-level scheduling and resource optimization, aiming for high availability and hardware utilization.
• Collaborate with ML researchers, SDK developers, and infrastructure engineers within Annapurna Labs and partner organizations to align the platform with current and future AI accelerators.
• Mentor and technically guide a team of software engineers, setting high standards for operational excellence, system design, and developer experience.
• Architect and implement scalable services spanning Kubernetes operators, workflow orchestration, and scheduling algorithms to maximize hardware utilization across accelerators.
• Collaborate daily with ML researchers, SDK developers, and hardware engineers to translate silicon capabilities into platform features.
• Own the full lifecycle of your systems from design and implementation through deployment, monitoring, and incident response.
• Improve developer velocity by refining CLI tools, APIs, and framework integrations to reduce friction between writing code and running at scale.
• Participate in design reviews, code reviews, and operational readiness discussions with a small, high-ownership team where contributions ship quickly and have immediate customer impact.
• Work in a fast-paced, startup-like environment where priorities are driven by the next generation of AI hardware on the roadmap.

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience in at least one software programming language
• 5+ years of leading design or architecture of new and existing systems, including design patterns, reliability, and scaling
• 5+ years of full software development life cycle experience including coding standards, code reviews, source control, build processes, testing, and operations
• Experience as a mentor, tech lead, or leading an engineering team
• Bachelor's degree in computer science or equivalent

Technologies

• Kubernetes

Benefits

• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments and restricted stock units (RSUs)

A Day in the Life

• Architect and implement scalable services spanning Kubernetes operators, workflow orchestration, and scheduling algorithms that maximize hardware utilization across a growing fleet of accelerators.
• Collaborate daily with ML researchers, SDK developers, and hardware engineers to translate emerging silicon capabilities into platform features.
• Own the full lifecycle of your systems, from design and implementation through deployment, monitoring, and incident response.
• Improve developer velocity by refining CLI tools, APIs, and framework integrations that reduce the friction between writing code and running it at scale.
• Participate in design reviews, code reviews, and operational readiness discussions with a small, high-ownership team where contributions ship quickly and have immediate customer impact.
• Work in a fast-paced, startup-like environment where priorities are driven by the next generation of AI hardware on the roadmap.

About the Team

Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge-sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our team members develop your engineering expertise so you feel empowered to take on more complex tasks in the future.

Diverse Experiences

AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

About AWS

Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Inclusive Team Culture

Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including Conversations on Race and Ethnicity CORE and AmazeCon (diversity) conferences, inspire us to never stop embracing our uniqueness.

Work/Life Balance

We value work-life harmony and offer flexibility as part of our working culture. When employees feel supported at home and at work, there’s nothing we can’t achieve in the cloud.

Mentorship & Career Growth

We’re committed to raising our performance bar as we work toward Earth’s Best Employer. You’ll find abundant knowledge-sharing, mentorship, and career-advancing resources to help you grow into a well-rounded engineering professional.