Senior Lead AI Engineer

Capital One is expanding its Gen AI Platform Services, Agentic AI, and is seeking a Senior Lead AI Engineer to help design, build, and deploy scalable AI and ML systems. The role centers on foundation model training, LLM inference, guardrails, governance, and observability to deliver AI-powered products for customers and associates. This is an onsite opportunity in New York, NY with a competitive salary range.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that transform how our associates work and how our customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and apply state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of AI/ML development experience, or a Master's degree in related fields with at least 4 years of AI/ML development experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.
• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
• Experience applying state-of-the-art techniques to optimize training and inference software to improve hardware utilization, latency, throughput, and cost.
• Passion for staying current with AI research and judiciously applying novel techniques in production.
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch
• Python
• Go
• Scala
• Java
• C++
• C#
• Golang

Benefits

• Health, financial and other benefits

Overview

At Capital One, the focus is on creating responsible and reliable AI systems that drive better banking outcomes. The company has a track record of leveraging machine learning to deliver real-time, personalized experiences for customers. Investments in technology infrastructure and top talent, combined with deep expertise in ML, position Capital One at the forefront of enterprises adopting AI. The work includes helping customers understand unusual charges and answering questions in real time.

Team Description

The Intelligent Foundations and Experiences (IFX) team sits at the center of Capital One's AI ambitions. We collaborate with partners across the organization to advance science and AI engineering, building and deploying proprietary solutions that are central to the business and deliver value to millions of customers. Our AI models and platforms empower teams to enhance products with the transformative power of AI while supporting business objectives.

The Ideal Candidate

You enjoy building robust systems and take pride in the quality of your work while advancing decisions that benefit customers. You stay current with the latest AI research and can judiciously apply novel techniques in production. You adapt quickly, ask questions to uncover root causes, and communicate findings clearly. You are technically strong with a solid foundation in engineering and mathematics, and you excel at spotting optimization opportunities across hardware and software. You are a resilient innovator who can chart new paths to meet business goals when the path isn’t obvious.