Senior Distinguished AI Engineer

Capital One is hiring a Senior Distinguished AI Engineer to help build and deploy responsible, scalable AI systems. Joining the Intelligent Foundations and Experiences (IFX) team, you will work across the full lifecycle of foundational AI, including foundation model and LLM components, guardrails, evaluation, experimentation, governance, and observability. This onsite role is based in New York, NY, with an annual salary range of USD 343,400 - 392,000.

The IFX team is central to turning Capital One’s AI vision into production capabilities. You will contribute to technical direction and help evolve the long term roadmap for foundational AI systems.

What you’ll do

• Collaborate with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that impact how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components across the stack, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Build with a broad set of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Develop and introduce state-of-the-art LLM optimization techniques to improve production performance, including scalability, cost, latency, and throughput.
• Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One.

Basic qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 10 years of experience developing AI and ML algorithms or technologies; or Master’s degree plus at least 8 years of experience developing AI and ML algorithms or technologies.
• At least 10 years of experience programming with Python, Go, Scala, or Java.

Preferred qualifications

• 9 years of experience deploying scalable and responsible AI solutions on cloud platforms (for example, AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience architecting, designing, developing, integrating, delivering, and supporting complex enterprise AI systems.
• Demonstrated ability to lead and mentor an engineering organization and influence cross-functional stakeholders up to the SVP level.
• Experience developing AI and ML algorithms or technologies (including LLM Inference, Similarity Search and VectorDBs, Guardrails, and Memory) using Python, C++, C#, Java, or Golang.
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Strong communication and presentation skills to articulate complex AI concepts to peers.

Eligibility and workplace notes

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• This role is eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
• Expected application acceptance: minimum of 5 business days.
• No agencies please.
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.
• Capital One Financial includes multiple entities; positions may correspond to different entities depending on posting location.