Applied AI Engineer
Job Description
Pantomath is hiring an Applied AI Engineer (Agents) to build and ship AI agent systems for complex enterprise data problems, from experiments to reliable production deployment.
Responsibilities
- Build and ship AI agents that solve complex enterprise problems and deliver meaningful customer value
- Advance model and agent capabilities using fine-tuning, post-training, and other adaptation approaches for enterprise task performance
- Design experiments and evaluations by building datasets, benchmarks, and feedback loops to measure progress and understand failure patterns
- Develop the systems behind agents, including services, integrations, and infrastructure for reliable execution at scale
- Move promising research into production by owning implementation, deployment, and ongoing improvement
- Improve production performance through practical tradeoffs across quality, reliability, latency, cost, and security
- Partner with engineering, product, and customer-facing teams to identify valuable problems and pursue approaches that work
Requirements
- Experience building and shipping AI systems with substantial hands-on contributions to code, experimentation, and production engineering
- Hands-on post-training experience using tools such as PyTorch, Hugging Face Transformers, TRL, and PEFT
- Ability to apply supervised fine-tuning and parameter-efficient adaptation such as LoRA, plus preference optimization and/or reinforcement learning
- Practical experience with LLMs, agent systems, and model evaluation
- Experience adapting or training models with attention to data quality, experimental design, and generalization
- Exposure to training and evaluation data pipelines, synthetic data generation, or human feedback systems
- Working knowledge of agent orchestration, tool use, retrieval, or inference optimization
- Comfort working with enterprise data platforms, distributed systems, or production AI infrastructure
- Familiarity with distributed GPU training and efficient inference using FSDP, DeepSpeed, or vLLM, plus reproducible experimentation and model evaluation
- Strong software engineering fundamentals and proficiency in Python, TypeScript, or comparable languages
- Ability to read research, reproduce useful results, and judge whether approaches translate to real-world performance
- Comfort owning ambiguous problems and moving between research exploration and product delivery
- Clear communication, technical judgment, and a collaborative approach
Technologies
- Python, TypeScript
- PyTorch
- Hugging Face Transformers
- TRL, PEFT, LoRA
- LLMs
- FSDP, DeepSpeed, vLLM
About Pantomath
- Pantomath is building the autonomous layer for enterprise Data Operations
- Agents catch data incidents, trace them to root cause across the stack, and resolve them using operational context across your entire stack
- Backed by a $30M Series B led by General Catalyst (with Sierra Ventures, Bowery Capital, Epic Ventures, and Hitachi Ventures)
- Pioneering the move from passive data monitoring to real-time, autonomous incident resolution
Equal Opportunity & Accommodations
- Pantomath is an Equal Opportunity Employer
- Employment decisions are based on qualifications, merit, and business needs
- Reasonable accommodations are available for qualified individuals during the application and interview process or throughout employment
- To request an accommodation, contact the Head of People
FLSA Compliance
- This position is classified as Exempt under the Fair Labor Standards Act (FLSA)
- Not eligible for overtime compensation
- Pay range: USD 150,000 - 230,000 per year
Location: San Francisco, CA (onsite)