Senior Lead AI Engineer (GenAI Platform Services)

Capital One is seeking a Senior Lead AI Engineer to help build responsible, reliable generative AI platform services. This onsite role in New York focuses on designing and delivering AI software components for large-scale production use, including foundation model training and LLM inference.

Role Responsibilities

• Collaborate with cross-functional teams of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Apply a broad stack of open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tooling.
• Develop and introduce advanced LLM optimization methods to improve production performance, including scalability, cost, latency, and throughput.
• Help shape the technical vision and contribute to the long-term roadmap for foundational AI systems at Capital One.

Required Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 6 years of experience developing AI and ML algorithms or technologies. Alternatively, a Master’s degree plus at least 4 years of experience developing AI and ML algorithms or technologies.
• At least 6 years of programming experience with Python, Go, Scala, or Java.

Technology Stack

Work may include AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and cloud and systems technologies across AWS, Google Cloud, Azure, plus programming languages such as Python, Go, Scala, Java, C++, C#, and Golang.

Team and Impact

The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life. Team members work closely with partners across the company to advance science and AI engineering, build and deploy proprietary solutions, and deliver value to millions of customers. AI models and platforms support other teams in enhancing products using responsible and scalable AI for high-leverage impact.

Compensation and Benefits

• Salary (New York, NY, onsite): USD 250,800 - 286,200 per year
• Eligible performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI)
• Comprehensive, competitive, and inclusive health, financial, and other benefits (eligibility varies)

Additional Salary Notes by Location

• Cambridge, MA: $229,900 - $262,400
• McLean, VA: $229,900 - $262,400
• New York, NY: $250,800 - $286,200
• San Jose, CA: $250,800 - $286,200

Candidates hired for other locations will receive the pay range associated with that location, and the offered annualized salary will be reflected in the candidate’s offer letter.

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (including LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang.
• Experience applying state-of-the-art optimization techniques for training and inference software to improve hardware utilization, latency, throughput, and cost.
• Excellent communication and presentation skills, including the ability to articulate complex AI concepts to peers.

Sponsorship and Recruiting Process

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• This role is expected to accept applications for a minimum of 5 business days.
• No agencies please.

Equal Opportunity and Workplace Notices

• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination under applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• Capital One will consider applicants with a criminal history consistent with applicable legal requirements (including, where applicable, New York Correction Law Article 23-A and other local and federal regulations).

If you require an accommodation, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]. For technical support or questions about the recruiting process, email [email protected].

Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site. Capital One Financial consists of multiple entities. Any position posted in Canada is for Capital One Canada, in the United Kingdom for Capital One Europe, and in the Philippines for Capital One Philippines Service Corp. (COPSSC).