Sr. Machine Learning Engineer, PXT EXR-Ops Tech

Amazon.com Services LLC is hiring a Senior Machine Learning Engineer to lead technical strategy and architecture for ML systems in PXT EXR-Ops Tech. Based in Bellevue, WA (onsite), this role focuses on designing production-grade AI services, including generative AI and LLMs, while driving platform decisions across teams.

Role Overview

As a technical leader, you will define and execute the ML strategy for your team and adjacent groups, shape large-scale system design, and guide how machine learning systems are served, governed, and operated. The work spans real-time and batch serving infrastructure, MLOps and model governance, responsible AI, and cost optimization, with hands-on involvement in technology evaluation and engineering execution.

Responsibilities

• Define and drive the ML technical strategy and architecture across your team and adjacent teams
• Design and lead the implementation of complex, multi-model ML systems at Amazon scale
• Architect ML platforms and frameworks that support rapid experimentation and deployment across the organization
• Lead design for real-time and batch ML serving infrastructure with high availability and low latency
• Drive adoption of ML best practices including MLOps, model governance, responsible AI, and cost optimization
• Evaluate and introduce new ML technologies and methods (including foundation models, RAG, fine-tuning, and RLHF)
• Coordinate cross-functional initiatives spanning science, engineering, product, and business teams
• Influence organization-wide technical decisions through design reviews, architecture reviews, and technical writing such as design documents and white papers
• Mentor and develop L4 and L5 ML engineers, including raising the hiring bar as a bar raiser or interviewer
• Improve operational excellence by defining SLAs, building dashboards, automating incident response, and reducing operational burden

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language
• 5+ years leading design or architecture work for new and existing systems (design patterns, reliability, and scaling)
• Experience as a mentor, tech lead, or engineering team lead
• Experience in technical support, or experience training and deploying machine learning systems for large-scale optimizations
• Experience building large-scale ML and AI solutions at Internet scale
• Experience creating and managing complex, cross-team project plans
• 4+ years distributed systems experience, or a Bachelor’s degree in engineering, technology, computer science, machine learning, robotics, operations research, statistics, mathematics, or an equivalent quantitative field
• Experience with ML and LLM fundamentals including architecture, training/inference lifecycles, and optimization of model execution, or experience building complex software systems delivered to customers

Benefits

• Sign-on payments
• Restricted stock units (RSUs)
• Health insurance, including medical, dental, vision, prescription, Basic Life & AD&D insurance, and option for Supplemental life plans; EAP; Mental Health Support; Medical Advice Line
• Flexible Spending Accounts
• Adoption and Surrogacy Reimbursement coverage
• 401(k) matching
• Paid time off
• Parental leave
• Option for Supplemental life plans
• EAP

Preferred Qualifications

• 5+ years of full software development life cycle experience including coding standards, code reviews, source control management, build processes, testing, and operations
• Bachelor’s degree in computer science or equivalent
• Experience leading engineering discussions about technology decisions and strategy related to a product
• Experience defining ML platform strategy and building reusable ML infrastructure

Salary: USD 168,100 - 227,400 per year.