Lead AI Engineer
Job Description
Build responsible, production-grade AI at Capital One’s Intelligent Foundations and Experiences (IFX) team. This role focuses on foundational AI, LLM core capabilities, and agentic AI, helping deliver AI-powered experiences that support how associates work and how customers interact with Capital One. You will design, develop, deploy, and optimize AI software components alongside cross-functional partners, with a platform mindset that prioritizes reliability, scalability, and high-leverage impact.
Location: New York, NY (onsite)
Salary: USD 215,200 - 245,600 per year
What you’ll do
- Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change day-to-day associate workflows and customer experiences.
- Design, develop, test, deploy, and support AI software components across the lifecycle, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a practical mix of Open Source and SaaS technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
- Introduce advanced LLM optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
- Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One.
Required qualifications
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related, plus at least 4 years of experience developing AI and ML algorithms or technologies; or a Master’s degree in a related field plus at least 2 years of experience developing AI and ML algorithms or technologies.
- At least 4 years of programming experience with Python, Go, Scala, or Java.
Technologies you may work with
Experience with systems and services across AI infrastructure, model platforms, and optimization pipelines, including: AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and languages such as Python, Go, Scala, Java, C++, C#, Golang. Cloud environments include AWS, Google Cloud, and Azure.
Team and impact
The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life by working closely with partners across the company. You will help advance the state of the art in science and AI engineering, building and deploying proprietary solutions central to the business and used by teams across Capital One to enhance products with AI in responsible and scalable ways.
Benefits
- Performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
- Comprehensive, competitive, and inclusive health, financial, and other benefits designed to support total well-being.
Preferred qualifications
- 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience designing, developing, delivering, and supporting AI services.
- Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
- A strong interest in staying current with AI research and applying novel techniques judiciously in production systems.
Similar Jobs