Senior Lead AI Engineer

Capital One is hiring a Senior Lead AI Engineer (Intelligent Foundations and Experiences team) to build and deploy responsible, scalable AI systems and LLM-enabled products.

Responsibilities

• Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associate workflows and customer experiences
• Design, develop, test, deploy, and support AI software components across foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Use a broad stack of Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tooling
• Develop state-of-the-art LLM optimization techniques to improve production performance, including scalability, cost, latency, and throughput
• Help shape technical vision and contribute to the long term roadmap for foundational AI systems at Capital One

Requirements

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, or Java

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch
• Python, Go, Scala, Java
• C++, C#, Golang
• AWS, Google Cloud, Azure

Team

• The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
• Partners across the company to advance the state of the art in science and AI engineering
• Builds and deploys proprietary solutions that support business needs and deliver value to millions of customers
• Enables teams across Capital One to enhance products with responsible and scalable AI at high leverage

Benefits

• Comprehensive, competitive, and inclusive health, financial, and other benefits that support total well-being

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, integrating, delivering, and supporting complex AI systems
• Demonstrated ability to lead and mentor engineering teams and influence cross-functional stakeholders
• Experience developing AI/ML algorithms or technologies (LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang
• Experience developing and applying state-of-the-art optimization techniques for training and inference software to improve hardware utilization, latency, throughput, and cost
• Strong interest in staying current with AI research and applying novel techniques responsibly in production
• Excellent communication and presentation skills to explain complex AI concepts to peers

Compensation

• McLean, VA (onsite): USD 229,900 - 262,400 per year
• Eligible for performance-based incentive compensation, which may include cash bonuses and/or long term incentives (LTI)