ServiceNow, based in Mountain View, California with onsite work, seeks a Senior Machine Learning Engineer to build and scale ML infrastructure for training and serving large language models at Moveworks, now part of ServiceNow. The role centers on distributed training and inference, model evaluation and monitoring, and latency optimization, with close collaboration across engineering, data analytics, machine learning experts, and product teams to deliver impactful features.
Benefits
- Health plans, including flexible spending accounts
- 401(k) Plan with company match
- Employee Stock Purchase Plan (ESPP)
- Matching donations
- Flexible time away plan
- Family leave programs
- Equity (when applicable)
Salary
Base salary range: $161,300 - $274,200 per year.
Responsibilities
- Design, build, and optimize scalable ML infrastructure that supports training, evaluation, and deployment of large language models
- Create abstractions to automate diverse steps across ML workflows
- Collaborate with cross functional teams—including engineers, data analytics, ML experts, and product—to deliver new features
- Apply your experience to drive ML and data engineering best practices across the organization
Requirements
- 5+ years of industry experience in machine learning, infrastructure, or related fields
- Hands-on experience with deep learning frameworks such as PyTorch or HuggingFace, and with LLM serving frameworks like vLLM or TensorRT-LLM
- Proven ability to build and scale end-to-end ML systems
- Experience designing scalable microservices and ETL pipelines
- Strong Python skills with experience in performant languages such as C++ or Go
- Bachelors degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field
- Interest in research publications within the machine learning and software engineering communities
- Effective communicator with experience collaborating across multiple teams
Technologies
- PyTorch
- HuggingFace
- vLLM
- TensorRT-LLM
- Python
- C++
- Go
Location
Mountain View, California (onsite).
Work Personas
ServiceNow structures work personas around flexibility and trust. Depending on the role and location, eligibility may involve a combination of flexible, remote, or in-office work arrangements. ServiceNow may verify the distance between your primary residence and the closest office via a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, creed, religion, sex, sexual orientation, national origin or ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other protected category. Candidates with arrest or conviction records will be considered in accordance with applicable laws.
Accommodations
We aim to provide an accessible and inclusive candidate experience. If you need a reasonable accommodation during the application process or require an alternative method to apply, please contact globaltalentss@servicenow.com for assistance.
Export Control Regulations
Some roles may require access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR). ServiceNow may need to obtain export control approval. All employment is contingent upon securing any necessary export licenses or approvals.
