AI Engineer 5 (AI Foundations: Evaluations and Agentic Workflows)

Capital One is hiring an AI Engineer 5 (AI Foundations: Evaluations and Agentic Workflows) to help build responsible, reliable AI systems within the Intelligent Foundations and Experiences (IFX) team.

Responsibilities

• Collaborate with cross-functional partners including engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One
• Design, develop, test, deploy, and support AI software components across foundation model training and inference, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Apply open source and SaaS AI technology including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch
• Drive state-of-the-art foundation model optimization to improve scalability, cost, latency, and throughput for large-scale production AI systems
• Shape the technical vision and long-term roadmap for foundational AI systems
• Design, implement, and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models
• Establish and lead cost-performance governance reviews across AI systems, including tracking GPU utilization, model throughput, and inference cost efficiency
• Participate in and/or lead team design councils or design review boards to maintain technical consistency and compliance with AI engineering standards
• Mentor Principal and Manager-level AI engineers to support cross-domain learning and raise organizational technical maturity

Requirements

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master’s degree in the same fields plus at least 4 years of experience
• At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java

Technologies

• AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• AWS, Google Cloud, Azure
• Python, Go, Scala, CUDA, Java
• C++, C#, Golang
• LLMs, vector search, Retrieval-augmented, rule-based

Team Description

• The Intelligent Foundations and Experiences (IFX) team is centered on delivering Capital One’s AI vision
• Partners across the company to advance science and AI engineering and builds and deploys proprietary solutions central to the business
• Empowers teams across Capital One to enhance products with responsible and scalable AI for high-leverage impact

Benefits

• Comprehensive, competitive, and inclusive health and financial benefits to support total well-being (eligibility varies)

Hybrid Position / On-site Presence

• Hybrid role with required on-site presence at the designated office location per Capital One’s hybrid policy

Incentive Compensation

• Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
• Incentives could be discretionary or non-discretionary depending on the plan

Application Timeline

• Expected to accept applications for a minimum of 5 business days

Equal Opportunity / Recruiting Notes / Accommodation

• No agencies please
• Equal opportunity employer (EOE, including disability and veteran status) committed to non-discrimination under applicable federal, state, and local laws
• Drug-free workplace
• Considers qualified applicants with criminal history in line with applicable laws regarding background inquiries
• Accommodation available: contact Capital One Recruiting at 1-800-304-9102 or [email protected] (confidential)
• Technical support/questions: [email protected]
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site

Salary / Location

• New York, NY (Hybrid): USD 250,800 - 286,200 per year
• Other location ranges listed: Cambridge, MA; McLean, VA; San Francisco, CA; San Jose, CA
• Pay range depends on work location; the offered annualized salary amount is reflected in the candidate’s offer letter

Sponsorship

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position