Machine Learning Engineer, Foundation Model Services

Build real-time foundation model experiences at scale

Apple’s Machine Learning Engineer role in Foundation Model Services focuses on creating production-grade solutions that serve large foundation models in real time. You will work on optimizing and serving large language, vision, and speech models across multiple Apple product experiences, with an emphasis on performance, reliability, and deployment.

What you’ll do

• Collaborate with product teams to deliver production-grade solutions that launch model serving for real-time customer use.
• Partner with foundation model researchers to prototype inference for advanced model architectures.
• Build tools to understand and remove performance bottlenecks across different hardware and use cases.
• Write high-quality code and ramp quickly in a fast-moving environment.
• Grow your influence by taking ownership of larger parts of the system over time.

What you bring

• 2+ years of industry experience building and shipping production software and/or machine learning systems.
• Proficiency in a modern programming language such as Go or Python.
• Experience deploying and operating services on a cloud platform (AWS, Azure, GCP, or equivalent), using containers and Kubernetes/Docker.
• 5 years+ of industry experience in ML technologies including LLMs, Machine Learning, NLP, Information Retrieval, and Statistics.
• Experience building or operating high-throughput, low-latency services.
• Strong communication and collaboration skills, with the ability to work across research and product teams.
• Bachelor’s degree or higher in Computer Science or a related technical field.

Helpful experience

• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server, and similar technologies.

Key tools and technologies

• Go, Python
• AWS, Azure, GCP
• Containers, Kubernetes, Docker
• Nvidia TensorRT-LLM, vLLLM, DeepSpeed
• Nvidia Triton Server

Benefits and support

• Comprehensive medical and dental coverage
• Retirement benefits
• Discounted products and free services
• Reimbursement for certain educational expenses, including tuition
• Discretionary employee stock programs, with an opportunity to become an Apple shareholder
• Eligible for discretionary restricted stock unit awards
• Option to purchase Apple stock at a discount through the Employee Stock Purchase Plan
• Additionally, this role might be eligible for discretionary bonuses or commission payments, as well as relocation

Location: Santa Clara, CA (onsite)
Compensation: USD 175,000 - 308,500 per year