Sr. AI Engineer (Full Stack)
Job Description
Peloton is building production-grade AI applications that connect autonomous agents into the company’s enterprise infrastructure. In this role, you will design the AI memory and state layer, integrate fragmented business data into a trustworthy foundation, and ship evaluation and cost-saving techniques that keep deployments reliable. This is a hands-on engineering position focused on turning ambiguous ideas into features that reach users quickly.
What you’ll do
- Convert ambiguous problem statements into functional, high-performing AI features and standalone tools.
- Solve the “State Problem” for AI by creating memory architectures and vector stores using Pinecone and Pgvector while strictly following data retention and deletion policies.
- Build pipelines and entity-resolution logic to connect data across CRM, ERP, CPQ, and marketing systems (including Salesforce, SAP, and BigQuery) into a single reliable source of truth agents can act on.
- Work with Peloton business units to understand workflows, identify high-value opportunities, and choose initial use cases to prove value.
- Partner closely with stakeholder teams to understand needs and drive adoption of what you build.
- Share field feedback that helps other teams understand model strengths and where they can improve.
- Deploy continuous evaluation pipelines to test for hallucinations, prompt injections, data leakage, and performance regressions before code reaches production.
- Implement Semantic Caching and smart routing logic to direct routine queries to smaller, lower-cost models to maintain low latency and efficient inference costs.
Required experience
- 5–7+ years of general software engineering.
- Strong software engineering fundamentals including distributed systems, async patterns, API design, microservices, and databases.
- Comfort switching languages or frameworks to move fastest toward working solutions.
- Hands-on production experience deploying RAG (Retrieval-Augmented Generation) and Agentic Workflows using LLM APIs, vector databases, and orchestration frameworks.
- Proven experience building and maintaining pipelines across fragmented enterprise systems (CRM, ERP, CPQ, marketing platforms), with emphasis on entity resolution, schema design, and data quality.
- Experience working with cutting-edge AI tools and compute resources.
- Demonstrated ability to ship work that reaches real users quickly, in days rather than months.
Tools and technologies
- Pinecone, Pgvector
- Salesforce, SAP, BigQuery
- RAG (Retrieval-Augmented Generation), LLM APIs
Location: New York, NY (hybrid)
Salary: USD 160,600 - 224,950 per year
Experience: 5+ years
Peloton is seeking a scrappy, creative, fast-moving AI Engineer who can rapidly turn raw ideas into production-grade applications. You will architect the Intelligence and Integration Layers that connect autonomous agents to Peloton’s enterprise infrastructure, focusing on systems thinking, engineering fundamentals, product sense, and the ability to ship quickly.