Senior Lead AI Engineer (FM Hosting)

What you gain: Capital One offers comprehensive health benefits, financial benefits, and other benefits, along with performance-based incentive compensation in cash bonuses and long-term incentives. The environment emphasizes responsible AI, collaboration, and continuous learning to drive innovations that reshape banking for good.

Overview

This role centers on leading the design, development, deployment, and governance of AI software components and foundational AI systems to deliver scalable, responsible AI for banking. You will collaborate with engineers, research scientists, product managers, and program managers to deliver AI powered products that transform how colleagues work and how customers interact with the bank. The role spans foundation model training, large language model inference, guardrails, governance, evaluation, experimentation, and observability, leveraging a diverse mix of Open Source and SaaS AI technologies.

Team

The Intelligent Foundations and Experiences (IFX) team sits at the heart of Capital One's AI efforts, partnering across the organization to advance AI engineering, deploy proprietary solutions, and empower teams to infuse products with AI that benefits millions of customers.

Responsibilities

• Collaborate with a cross functional team of engineers, research scientists, technical program managers, and product managers to deliver AI powered products that impact how colleagues work and how customers engage with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and apply state of the art LLM optimization techniques to improve production system performance focusing on scalability, cost, latency, and throughput.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.

Technologies

• Python
• Go
• Scala
• Java
• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch

Basic Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field with at least 6 years of AI and ML algorithm or technology development experience, or a Master's degree in these fields with at least 4 years of such experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (eg LLM inference, similarity search and vector databases, guardrails, memory) using Python, C++, C#, Java, or Go.
• Experience advancing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Strong interest in AI research and applying novel techniques in production with prudent judgment.
• Excellent communication and presentation skills, able to articulate complex AI concepts to peers.