Sr. Machine Learning Engineer

Amazon Ads is hiring a Senior Machine Learning Engineer in New York, NY (onsite) to build ML infrastructure and architectural direction for ad response prediction across large-scale training, real-time inference, and LLM-based GenAI workloads.

Responsibilities

• Lead development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale, including technical strategy, tradeoff evaluation, and delivery of production-ready solutions
• Own architectural direction for large-scale ML training and real-time inference systems, driving improvements in scalability, automation, and efficiency across the organization
• Partner with applied scientists to design and optimize end-to-end ML pipelines from training and evaluation through deployment and serving, ensuring reliable model performance at massive scale
• Set and promote ML infrastructure best practices and contribute to cross-team architectural decisions beyond your immediate team
• Make principled tradeoff decisions on complex and ambiguous problems in a fast-moving GenAI environment, with independent delivery of results
• Mentor engineers across the team and serve as a technical resource for ML infrastructure expertise

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience with at least one software programming language
• 5+ years leading design or architecture of new and existing systems, including design patterns, reliability, and scaling
• Experience as a mentor, tech lead, or leading an engineering team
• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
• Bachelor’s degree in computer science or equivalent

Location

• New York, NY (onsite)

Compensation

• USD 193,300 - 227,400 per year

Benefits

• Comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, option for Supplemental life plans), EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments
• Restricted stock units (RSUs)