Staff AI Engineer

Arm is building tools and technologies that let physical-AI agents interact with real devices across both cloud and edge environments. In this role, you will help develop SDKs and frameworks, along with evaluation and support capabilities that strengthen an open-source platform for external developers and partner deployments.

This Staff AI Engineer position is based in Seattle, WA (onsite) and is focused on designing agent-to-device experiences, powering them with practical inference runtimes, and maintaining the security and operational foundations needed for reliable deployments.

What you’ll work on

• Design and implement features in SDKs and reference services across both the device side and the agent side
• Build reference applications and demos that connect agents to real devices across edge and cloud, using PyTorch-ecosystem inference runtimes and popular agent frameworks
• Create evaluation harnesses to measure reliability, latency, and correctness of agent-to-device interactions, then use results to improve the product
• Bring up and maintain a fleet of development hardware including single-board computers, cameras, sensors, robot platforms, and edge servers for development, testing, and demonstrations
• Contribute to the platform’s security and operational posture, including identity, authorization, observability, and safe failure behavior
• Write documentation, samples, and learning materials for external developers, and support the open-source community through issues, reviews, and contributions
• Collaborate with architects, product managers, and partner engineers on requirements, API design, and release quality

What you bring

• Professional software engineering experience building distributed systems, with strong Python and working proficiency in at least one of C++, Rust, or Go
• Experience building and shipping AI-powered applications, including LLM tool use or agent frameworks, and integrating them with real systems
• Practical experience deploying ML models for inference on servers or edge devices using PyTorch or a comparable framework
• Solid grounding in messaging, RPC, concurrency, failure handling, and testing for networked software
• Comfort with Linux, embedded single-board computers, containers, and CI/CD workflows
• Clear written and verbal communication, with the ability to work across hardware, systems, and ML disciplines
• A degree or equivalent experience in Computer Science, Electrical Engineering, Robotics, or a related field

Technologies you’ll use

• Python, C++, Rust, Go
• PyTorch, LLM tool use, agent frameworks, PyTorch-ecosystem inference runtimes
• Linux, containers, CI/CD workflows
• RPC, single-board computers, embedded single-board computers
• PyTorch or a comparable framework

Nice to have

• Experience with publish/subscribe messaging systems or IoT protocols
• Familiarity with the Model Context Protocol or similar agent-tool interfaces
• Robotics or physical-AI background, such as ROS 2, robot arms, perception pipelines, or control loops
• On-device inference experience with ExecuTorch, ONNX Runtime, or vendor NPU toolchains, and LLM serving with vLLM or similar
• Experience designing evaluations or benchmarks for AI agents
• Open-source contributions and experience supporting an external developer community
• Security fundamentals for connected devices

Compensation and location

Location: Seattle, WA (onsite)

Salary range: USD 170,900 - 231,200 per year

No relocation package is available for this role.