EngineerJobs.io
← Back to all jobs
Pantograph

Robotics Machine Learning Engineer

San Francisco, CA $150k - $260k/yr Full time Posted 1d ago

Job Description

Pantograph is looking for a Robotics Machine Learning Engineer to help bring capable AI models to robots that can perform meaningful work in the real world. The position focuses on connecting models to robot observations and actions, engineering the tools and controllers the models depend on, and building evaluations across both simulation and the company’s fleet.

In this role, you will help determine when a frontier model should act directly versus coordinating faster learned policies or classical controllers, and when the system should generate its own tools or control code. You will also partner with research, robot software, and product teams to keep experimentation tightly linked to real hardware results.

Responsibilities

  • Design and build the systems that turn capable AI models into robots doing useful work in the real world.
  • Connect models to robot observations and actions.
  • Build the tools, skills, and controllers the models rely on.
  • Develop evaluations in simulation and on the fleet.
  • Investigate when a frontier model should act directly, when it should coordinate faster learned policies or classical controllers, and when it should write its own tools or control code.
  • Weigh tradeoffs across capability, reliability, latency, safety, and how easily the system can be understood and supervised, using real deployments to guide decisions.
  • Work closely with research, robot software, and product teams to create a tight loop between experiments and experience on real hardware.
  • Analyze failures to determine whether they require changes to observations, tools, orchestration, policies or controllers, or other parts of the system.

Requirements

  • Deep experience in robotics including control, perception, planning, and learned policies, with demonstrated experience getting robots to do useful work on real hardware.
  • Use of simulation to develop and test systems, with an understanding of where simulation diverges from reality.
  • Experience designing and shipping robotic or AI systems used by people, with clear evidence of what improved outcomes.
  • Strong experimental design and results interpretation skills, including separating competing explanations, identifying confounders, and understanding what evidence does and does not establish.
  • Intuitive understanding of model behavior, including what models grasp, what confuses them, and how behavior changes with tools, context, and feedback.
  • Interest in investigating failures and understanding system behavior beyond aggregate metrics.
  • Pragmatism about methods, prioritizing performance on real tasks over novelty or complexity.
  • Ability to build reliable software across the stack, from model APIs and inference to robot software and testing infrastructure.
  • Clear communication and comfort collaborating across research and engineering teams.
  • Extremely effective use of AI tools.

Bonus if You’ve Worked With

  • Agent harnesses, tool use, memory, or long-horizon tasks.
  • Systems where models write and execute code or develop their own tools.
  • Fine-tuning vision-language-action models or other large robot policies.
  • Teleoperation, robot data collection, or learning from fleet data.
  • Evaluation design, failure analysis, or safety testing.
  • Inference optimization, including latency, throughput, and cost.

Compensation

USD 150,000 - 260,000 per year

Location: San Francisco, CA (onsite)

Similar Jobs