Senior Machine Learning Engineer, Agentic Systems

ServiceNow is seeking a Senior Machine Learning Engineer for the Agentic Systems group to design and scale end-to-end ML infrastructure for training, evaluating, and deploying large language models. This role underpins Moveworks' production ML and NLP models that serve hundreds of millions of enterprise employees, blending research insight with production-grade engineering. The position is onsite in Mountain View, California.

Responsibilities

• Develop and refine scalable ML infrastructure enabling end-to-end workflows for training, evaluating, and deploying large language models.
• Create abstractions to automate multiple steps across diverse ML pipelines.
• Partner with cross-functional teams including engineers, data analytics, ML experts, and product to deliver new features.
• Apply your experience to advance ML and data engineering best practices.

Requirements

• Minimum five years of professional experience in machine learning, ML infrastructure, or related fields.
• Hands-on experience with deep learning frameworks such as Pytorch or Huggingface, or with LLM serving frameworks like vLLM or TensorRT-LLM.
• Proven track record building and scaling end-to-end ML systems.
• Experience developing scalable microservices and ETL pipelines.
• Strong Python skills and experience with performant languages such as C++ or GoLang.
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
• Interest in ML and software engineering research publications.
• Effective communicator with demonstrated cross-functional collaboration.

Technologies

• Pytorch
• Huggingface
• vLLM
• TensorRT-LLM
• Python
• C++
• GoLang