Senior Machine Learning Engineer, Agentic Systems

This senior machine learning engineer will join ServiceNow's Agentic Systems team in Mountain View, operating onsite to design and scale ML infrastructure for large language models. The role emphasizes end-to-end support for training, inference, evaluation, monitoring, and latency optimization, with close collaboration across product, engineering, data analytics, and ML specialists.

Role overview

As a Senior Machine Learning Engineer, you will architect and optimize scalable infrastructure to enable training, evaluation, and deployment of large language models. You will develop abstractions to streamline diverse ML workflows and influence best practices in ML engineering across the organization.

Responsibilities

• Design, build, and optimize scalable ML infrastructure to support training, evaluation, and deployment of large language models.
• Create abstractions that automate multiple steps across various ML workflows.
• Collaborate with cross-functional teams, including engineers, data analysts, ML experts, and product managers, to deliver new features.
• Leverage experience to drive best practices in ML and data engineering.

Requirements

• Minimum 5 years of industry experience in Machine Learning, Infrastructure, or related fields.
• Experience with deep learning frameworks such as PyTorch or Hugging Face, or LLM serving frameworks like vLLM or TensorRT-LLM.
• Experience building and scaling end-to-end machine learning systems.
• Experience building scalable microservices and ETL pipelines.
• Strong proficiency in Python with experience in performant languages such as C++ or Go.
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
• A demonstrated interest in research publications within machine learning and software engineering communities.
• Effective communication and experience collaborating across multiple teams.

Technologies

• PyTorch
• Hugging Face
• vLLM
• TensorRT-LLM
• Python
• C++
• Go

Salary

Base annual salary range: $161,300 to $274,200.

Location

Mountain View, California, onsite.

Work Personas

ServiceNow operates with flexible and trust-based work arrangements. Work personas, which may be flexible, remote, or in-office, are assigned based on the nature of the work and location. Eligibility may involve confirming the distance between your primary residence and the closest ServiceNow office using a third-party service.