Capital One’s Intelligent Foundations and Experiences (IFX) team is seeking an AI Engineer 4 to help build responsible, reliable AI systems.

Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers
Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, and model evaluation/experimentation
Apply foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput
Contribute to technical vision and the long-term roadmap for foundational AI systems at Capital One
Own end-to-end architecture for complex AI systems with emphasis on maintainability, observability, and ethical alignment
Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift
Partner with infrastructure engineering to optimize GPU/TPU utilization and accelerate inference pipelines
Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance requirements are met
Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation

Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus at least 4 years experience developing AI/ML algorithms or technologies, or Master’s degree in a related field plus at least 2 years experience developing AI/ML algorithms or technologies
At least 4 years of programming experience with Python, Go, Scala, CUDA, or Java

The Intelligent Foundations and Experiences (IFX) team advances Capital One’s AI vision through state-of-the-art science and AI engineering
Builds and deploys proprietary AI solutions that support teams across Capital One
Enables responsible, scalable AI model and platform capabilities for high-leverage impact across millions of customers

Experience leading development AI systems with tradeoff decisions across cost, latency, throughput, and accuracy
6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
Experience designing, developing, delivering, and supporting AI services
Experience developing AI/ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang
Experience applying state-of-the-art training and inference optimization techniques to improve hardware utilization, latency, throughput, and cost
Experience building agentic AI systems and agentic workflows
Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale
Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules
Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms

Hybrid role with required on-site presence at the designated office location per Capital One’s hybrid policy

New York, NY: $215,200 - $245,600 per year
Performance-based incentive compensation may include cash bonus(es) and/or long term incentives (LTI)

AI Engineer 4

Job Description