Lead AI Engineer

Capital One is hiring a Lead AI Engineer for onsite work in McLean, VA. In this role, you will help design, develop, deploy, and support foundational AI capabilities, with an emphasis on responsible and reliable AI systems.

Role Focus

The Lead AI Engineer will lead efforts across foundational AI systems, including large language model inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components spanning foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Apply a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
• Develop and introduce state-of-the-art LLM optimization techniques to improve performance, including scalability, cost, latency, and throughput for production AI systems.
• Support the technical vision and long-term roadmap for foundational AI systems at Capital One.

Required Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 2 years of experience developing AI and ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, or Java.
• At least 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, delivering, and supporting AI services.
• Experience developing AI and ML algorithms or technologies (including LLM Inference, Similarity Search and VectorDBs, Guardrails, and Memory) using Python, C++, C#, Java, or Golang.
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Ability to stay current with AI research and apply novel techniques thoughtfully in production.

Technologies

• AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
• AWS, Google Cloud, Azure
• Python, Go, Scala, Java, C++, C#, Golang
• LLM Inference, Similarity Search, Guardrails, Memory

Team Overview

The Intelligent Foundations and Experiences (IFX) team builds and deploys proprietary solutions at the center of bringing Capital One’s AI vision to life. The team collaborates with partners across the company to advance the state of the art in science and AI engineering, and to empower teams with responsible and scalable AI capabilities that deliver high-leverage impact for millions of customers.

Benefits

• Performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
• A comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being.

Compensation

McLean, VA: USD 197,300 - 225,100 per year (Lead AI Engineer). Compensation ranges listed for other locations vary by location, and candidates hired in other locations will receive the pay range associated with that location as reflected in the offer letter.

Additional Information

• Applications will be accepted for a minimum of 5 business days.
• No agencies please.
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• Capital One will consider qualified applicants with a criminal history in a manner consistent with applicable laws.
• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• Accommodations for candidates who visited the website to search or apply can be requested via Capital One Recruiting at 1-800-304-9102 or [email protected].
• For technical support or questions about the recruiting process, email [email protected].
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.
• Capital One Financial includes multiple entities. Posting in Canada is for Capital One Canada; posting in the United Kingdom is for Capital One Europe; posting in the Philippines is for Capital One Philippines Service Corp. (COPSSC).