Senior AI Engineer

ServiceTitan, Inc. is seeking a Senior AI Engineer to build scalable, low-latency machine learning systems and production services. The role focuses on taking models from development to deployment, including LLMs and other specialized models, with an emphasis on integrating them into real-time customer-facing experiences.

This position is based in California (onsite) and offers a USD 168,200 - 269,900 annual salary range. A minimum of 5 years of relevant experience is required.

What you’ll do

• Design and implement scalable, low-latency machine learning systems and services, including model training, inference, and deployment infrastructure.
• Partner with product teams to integrate, operationalize, and deploy machine learning models into production, including foundational models (LLMs), traditional ML models, and specialized models for speech, NLP, and forecasting.
• Improve the performance and real-time responsiveness of ML pipelines to support a strong customer experience and minimize latency.
• Communicate effectively with engineers, product managers, customers, and partners to align on outcomes and delivery.

What you bring

• 5+ years of experience writing production-level code in Python.
• 2+ years of experience deploying machine learning models (for example: NLP, speech, forecasting, or recommendation systems) to production at scale.
• Experience designing, building, and deploying scalable ML inference services for real-time or high-throughput applications.
• Advanced knowledge of machine learning methods and algorithms across traditional ML and deep learning theory and techniques.
• Experience with reinforcement learning (RL) and implementing continuous learning or online optimization systems for production.
• Understanding of the ML project lifecycle from experimentation to production deployment.
• Experience with databases/data warehouses including SQL Server, PostgreSQL, Redshift, and Snowflake.
• Experience with public cloud environments such as Azure or AWS.
• Experience with microservices and asynchronous messaging technologies like Kafka and Azure Service Bus (critical for high-volume, real-time systems).
• Experience with serverless architecture such as Azure Functions or AWS Lambda.
• Experience with Azure Cognitive Services or similar cloud-based AI offerings is a plus.
• Familiarity with Git, unit testing, debugging, profiling, JIRA, and other developer tools.
• Comfort working in a fast-paced environment with a globally distributed team.

Tools and technologies

• Python, Azure Cloud, AIOps, MLOps
• LLMs, NLP, speech, forecasting
• SQL Server, PostgreSQL, Redshift, Snowflake
• Azure, AWS, Kafka, Azure Service Bus, Azure Functions, AWS Lambda
• Azure Cognitive Services
• Git, JIRA, microservices, serverless architecture

Benefits

• Flextime, recognition, and support for autonomous work
• Flexible time off with ample learning and development opportunities
• Comprehensive onboarding program
• Leadership training for Titans at all levels
• Bonusly, peer-nominated awards, and more
• Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents)
• FSA and HSA
• 401k match
• Telehealth options including memberships to One Medical
• Parental leave and support
• Up to $20k in fertility services (IUI and IVF)
• Surrogacy and adoption reimbursement
• On demand maternity support through Maven Maternity
• Free breast milk shipping through Maven Milk
• Pet insurance
• Legal advisory services
• Financial planning tools

Recruitment AI use

ServiceTitan uses technology, including automated and AI-assisted tools, to support certain aspects of the recruitment process. AI tools are not used to make hiring decisions; all hiring decisions are made by the hiring teams.

Be human with us

The team emphasizes that being human is not about checking every box. If you have the relevant skills but hesitate to apply due to background, the company encourages applying.