EngineerJobs.io
← Back to all jobs
Apple

Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil

Cupertino, CA $185k - $325k/yr Full time Posted 1d ago

Job Description

The Senior Machine Learning Engineer will help develop intelligence capabilities for Apple Pencil, with a focus on multimodal free-form ink understanding and generative features. The role covers work from early prototypes through production deployment, including on-device optimization for Apple’s ecosystem.

Responsibilities

  • Build machine learning systems that bring intelligence to Apple Pencil.
  • Contribute to both perception and generation, including understanding rich free-form ink in its full multimodal context and powering generative features that create and transform content from ink inputs.
  • Apply large language models and classical machine learning as appropriate for each feature.
  • Own problems end to end, from framing the interaction and prototyping on iPad with real Apple Pencil input to measuring success and shipping results.
  • Work closely with design, frameworks, and app teams across Apple to deliver integrated user experiences.
  • Stay current with AI research to rapidly apply high-impact developments, while also developing new ideas tailored to Apple Pencil and Apple’s platform.

Requirements

  • 5+ years of industry experience building ML-powered product features, including hands-on work with multimodal models.
  • Experience taking an ML system from prototype through evaluation to production deployment.
  • Strong software engineering skills in Python and at least one of Swift, C++, or Objective-C.
  • Experience with a modern ML framework such as PyTorch or JAX.
  • MS or PhD in Computer Science or a related field, or equivalent industry experience.
  • Experience building agentic workflows and designing LLM-based evaluation judges.

Preferred Qualifications

  • Proficiency with agentic coding tools and workflows for prototyping, optimization, and developing production code.
  • Experience with generative models for images or other visual content.
  • Experience with on-device machine learning, including quantization, distillation, latency, and memory budgets.

Key Technologies

  • Python, Swift, C++, Objective-C
  • PyTorch, JAX
  • Large language models, multimodal models
  • iPad, Apple Pencil
  • LLM-based evaluation judges

Compensation and Location

Location: Cupertino, CA (onsite).
Salary: USD 184,700 - 324,800 per year.

Benefits

  • Comprehensive medical and dental coverage
  • Retirement benefits
  • A range of discounted products and free services
  • Reimbursement for certain educational expenses, including tuition

Similar Jobs