This onsite role in Mountain View, California focuses on designing and scaling machine learning infrastructure to support training and serving large language models, with emphasis on distributed training, inference pipelines, evaluation, latency optimization, and productionizing infrastructure.
Responsibilities
- Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
- Develop abstractions to automate various steps across different ML workflows.
- Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to deliver new features.
- Leverage experience to advance best practices in ML and data engineering.
Requirements
- 5+ years of industry experience in Machine Learning, Infrastructure or related fields.
- Experience with deep learning frameworks such as PyTorch or Hugging Face, or LLM serving frameworks such as vLLM or TensorRT-LLM.
- Experience building and scaling end-to-end machine learning systems.
- Experience building scalable microservices and ETL pipelines.
- Expertise in Python and experience with performant languages such as C++ or Go.
- Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
- An interest in research publications within the machine learning and software engineering communities.
- Effective communicator with experience collaborating cross-functionally with other teams.
Technologies
- Pytorch
- Huggingface
- vLLM
- TensorRT-LLM
- Python
- C++
- GoLang
Additional Information
Work Personas: ServiceNow adopts flexible work arrangements within a framework of trust. Work personas, indicating flexible, remote, or onsite requirements, are assigned based on the nature of the work and location. Eligibility for a work persona may involve verifying the distance between your primary residence and the nearest ServiceNow office through a third-party service.
Equal Opportunity Employer: ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law.
Accommodations: ServiceNow is committed to providing an accessible and inclusive candidate experience. If you require a reasonable accommodation to complete any part of the application process, or cannot use this online application and need an alternative method to apply, please contact globaltalentss@servicenow.com for assistance.
Export Control Regulations: For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities. All employment is contingent upon ServiceNow obtaining any export license or other approvals that may be required by applicable export control authorities.
