Scale and optimize a cutting-edge generative AI conversation engine for enterprise use.

Build a scalable product infrastructure with intuitive interfaces that enable engineers and configurators to customize and optimize generative AI models.
Collect data and feedback, adapting to diverse enterprise use cases and business contexts.
Deliver domain-specific conversational experiences tailored to customer needs.
Design scalable API abstractions for the conversation platform, supporting MS Teams, Slack, and Web clients, plus a neutral API for other engineering system components.
Optimize the dialog engine to handle a wide range of features, leveraging private domain knowledge for each enterprise in the cloud, and enable real-time multilingual translation with minimal memory usage and low latency.
Promote best practices in coding, API design, scalability, robustness, and optimization; foster a culture of excellence and continuous improvement among engineers.
Provide visibility into product performance with a robust logging and tracing framework, user-friendly debugging and triaging tools, and automated metrics for monitoring and analysis.
Collaborate closely with ML engineers, application engineers, product teams, and customer support to drive new features and scalability initiatives.

Strong foundation in computer science and software engineering with experience building scalable systems.
Deep understanding of clean, modular, and scalable API design; ability to champion coding practices and raise standards across the team.
Passion for optimizing systems; proficient with tracing, logging, and metrics; systematic approach to addressing latency, race conditions, and throughput bottlenecks.
Ability to independently research new requirements and develop innovative solutions; thrives in fast-paced coding with rapid iterations.
Excellent communication skills and cross-functional collaboration capabilities; able to articulate rationales and design approaches.
Bachelor's degree or higher in computer science or a related field.
7+ years of professional development experience building systems at scale.

Staff Machine Learning Engineer, Agentic App Platform

Job Description