Senior Lead AI Engineer (FM Hosting, LLM Inference)

The Senior Lead AI Engineer role centers on FM Hosting and large language model inference within Capital One's Intelligent Foundations and Experiences (IFX) team. The position focuses on building and optimizing scalable AI systems and platforms for real-time banking applications.

Overview

Capital One is advancing responsible and reliable AI to transform banking. The firm has a history of using machine learning to deliver real-time, personalized customer experiences and continues to invest in technology infrastructure and top AI talent to stay at the forefront of enterprise AI. The aim is to deploy robust AI capabilities that support both associates and customers.

Responsibilities

• Collaborate with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Utilize a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
• Invent and apply state-of-the-art LLM optimization techniques to enhance scalability, cost efficiency, latency, and throughput for large scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies.
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch
• Python
• Go
• Golang
• Scala
• Java
• C++
• C#

Benefits

• Health benefits
• Financial benefits
• Performance-based incentives including cash bonuses and long-term incentives

Team Description

The Intelligent Foundations and Experiences (IFX) team sits at the core of Capital One's AI strategy, collaborating with partners across the organization to advance AI science and engineering. The team develops and deploys proprietary AI solutions that drive business value for millions of customers and empowers internal teams to leverage AI in product enhancements.

The Ideal Candidate

• Enjoys building systems, takes pride in code quality, and shares a commitment to doing what's right. Seeks work that helps transform banking for the better.
• Keeps pace with the latest research, can interpret scientific publications, and judiciously apply novel techniques in production.
• adapts quickly to undefined problems, seeks clarity, asks questions, and communicates findings succinctly. Willing to propose new ideas even when unproven.
• Is technically deep with a strong foundation in engineering and mathematics, with expertise across hardware, software, and AI to identify optimization opportunities others may miss.
• Actively forges new paths to achieve business goals when routes are uncertain, demonstrating resilience and initiative.