Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil
Job Description
The Senior Machine Learning Engineer will help develop intelligence capabilities for Apple Pencil, with a focus on multimodal free-form ink understanding and generative features. The role covers work from early prototypes through production deployment, including on-device optimization for Apple’s ecosystem.
Responsibilities
- Build machine learning systems that bring intelligence to Apple Pencil.
- Contribute to both perception and generation, including understanding rich free-form ink in its full multimodal context and powering generative features that create and transform content from ink inputs.
- Apply large language models and classical machine learning as appropriate for each feature.
- Own problems end to end, from framing the interaction and prototyping on iPad with real Apple Pencil input to measuring success and shipping results.
- Work closely with design, frameworks, and app teams across Apple to deliver integrated user experiences.
- Stay current with AI research to rapidly apply high-impact developments, while also developing new ideas tailored to Apple Pencil and Apple’s platform.
Requirements
- 5+ years of industry experience building ML-powered product features, including hands-on work with multimodal models.
- Experience taking an ML system from prototype through evaluation to production deployment.
- Strong software engineering skills in Python and at least one of Swift, C++, or Objective-C.
- Experience with a modern ML framework such as PyTorch or JAX.
- MS or PhD in Computer Science or a related field, or equivalent industry experience.
- Experience building agentic workflows and designing LLM-based evaluation judges.
Preferred Qualifications
- Proficiency with agentic coding tools and workflows for prototyping, optimization, and developing production code.
- Experience with generative models for images or other visual content.
- Experience with on-device machine learning, including quantization, distillation, latency, and memory budgets.
Key Technologies
- Python, Swift, C++, Objective-C
- PyTorch, JAX
- Large language models, multimodal models
- iPad, Apple Pencil
- LLM-based evaluation judges
Compensation and Location
Location: Cupertino, CA (onsite).
Salary: USD 184,700 - 324,800 per year.
Benefits
- Comprehensive medical and dental coverage
- Retirement benefits
- A range of discounted products and free services
- Reimbursement for certain educational expenses, including tuition