Sr. Lead AI Engineer (GenAI Platform)

Capital One is building responsible and reliable AI systems that aim to change banking for good. In this role, you will help develop and deploy foundational AI capabilities, focusing on LLM platforms and the engineering practices needed to optimize, govern, and observe production systems.

You will work with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One.

Role Focus

• Build foundational AI capabilities and components for banking use cases
• Support LLM platforms with capabilities for training, inference, evaluation, and operational governance
• Improve performance across production AI systems, including scalability, cost, latency, and throughput
• Help shape the technical vision and long term roadmap of foundational AI systems

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
• Introduce state-of-the-art LLM optimization techniques to improve large scale production performance, including scalability, cost, latency, and throughput
• Contribute to the technical vision and long term roadmap for foundational AI systems at Capital One

Team

• The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
• IFX works with partners across the company to advance the state of the art in science and AI engineering, and builds and deploys proprietary solutions
• AI models and platforms from IFX empower other teams to enhance products with AI in responsible and scalable ways

Requirements

• Education: Bachelor’s degree in Computer Science/AI/EE/CE or related fields (or a Master’s in the same areas)
• Experience: At least 6 years developing AI and ML algorithms or technologies (or at least 4 years with a Master’s)
• Programming: At least 6 years of experience programming with Python, Go, Scala, or Java

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch
• Open Source and SaaS AI technologies
• Foundation model training
• Large language model inference
• Similarity search
• Guardrails
• Model evaluation
• Experimentation
• Governance
• Observability
• LLM optimization techniques
• Languages and platforms: Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, integrating, delivering, and supporting complex AI systems
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers

Benefits

• Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
• Comprehensive, competitive, and inclusive set of health, financial and other benefits that support total well-being

Location

• New York, NY (onsite)

Salary Information

• USD 250,800 - 286,200 per yearly (New York, NY)

Additional Information

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
• Applications are expected to be accepted for a minimum of 5 business days
• No agencies please; Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
• Capital One promotes a drug-free workplace
• Capital One will consider for employment qualified applicants with a criminal history consistent with applicable law
• Accommodation requests can be directed to Capital One Recruiting at 1-800-304-9102 or via [email protected]
• For technical support or questions about the recruiting process, email [email protected]
• Capital One does not provide, endorse, nor guarantee third-party products, services, educational tools, or other information available through this site
• Capital One Financial is made up of several different entities