Sr. Manager, AI Engineer
Job Description
Capital One is hiring a Sr. Manager, AI Engineer to lead efforts that operationalize responsible, scalable AI systems built around production foundation models and related capabilities. In this onsite role in San Jose, you will guide AI software components from design through deployment, while partnering across Research, Data, Platform, and product teams to deliver measurable outcomes.
What you’ll do
- Work with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that affect how associates work and how customers interact with Capital One
- Oversee the design, development, testing, deployment, and support of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
- Make high-judgment build-versus-buy decisions across Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more
- Introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems
- Contribute to the technical vision and long-term roadmap for foundational AI systems
- Attract and retain AI talent, support personal and professional development, and help the team keep pace with the state-of-the-art
- Translate enterprise AI goals into team roadmaps with measurable outcomes and recurring readouts
- Operationalize Responsible AI by establishing review gates, documentation and evaluation expectations, and rollout and rollback standards for production systems
- Build collaboration interfaces with Research, Data, and Platform teams to accelerate the model lifecycle
Minimum qualifications
- Education: Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
- Experience: At least 4 years developing AI and ML algorithms or technologies
- People leadership: At least 1 year of people leadership experience
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
- Python, C++, C#, Java, CUDA, Golang
- AWS, Google Cloud, Azure
Compensation and location
- Location: San Jose, CA (onsite)
- Salary: USD 250,800 - 286,200 per year
Ideal candidate attributes include a strong drive to build high-quality systems while acting responsibly, staying current with AI research and applying new techniques in production, and mentoring others through coaching and hands-on leadership when needed. You thrive on complex, ambiguous problems, ask probing questions to reach root causes, communicate findings clearly, and contribute technical judgment that balances engineering execution with innovation.