Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Responsibilities

• Collaborate with a cross functional team of engineers, research scientists, technical program managers, and product managers to deliver AI driven products that alter how associates work and how customers engage with Capital One.
• Design, build, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, among other areas.
• Utilize a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput for large scale production AI systems.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field with at least 4 years of experience developing AI and ML algorithms or technologies; or a Master’s degree in the same fields with at least 2 years of experience.
• At least 4 years of experience programming with Python, Go, Scala, or Java.

Technologies

• Python
• Go
• Scala
• Java
• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch

Benefits

• Health benefits
• Performance-based incentive compensation (cash bonuses and/or long term incentives)

Team

The Intelligent Foundations and Experiences (IFX) team sits at the core of Capital One's AI strategy. The group partners across the company to advance AI science and engineering, building and deploying proprietary solutions central to the business and delivering value to millions of customers. The AI models and platforms developed by IFX empower teams across Capital One to enhance products with AI capabilities.