AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

Capital One’s Intelligent Foundations and Experiences (IFX) team is building responsible and reliable GenAI platform services. This AI Engineer 4 role focuses on agentic AI, guardrails, and model evaluation, with ownership spanning end-to-end system architecture through deployment and operational excellence.

Role Focus

You will help design and deliver AI-powered platform components that support how associates work and how customers interact with Capital One. The work includes foundation model training and large language model inference, along with agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

Key Responsibilities

• Collaborate with cross-functional partners, including engineers, research scientists, technical program managers, and product managers, to deliver AI-powered products across Capital One.
• Design, develop, test, deploy, and support AI software components such as foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, and model evaluation.
• Apply Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and other supporting tools.
• Develop and introduce foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap for foundational AI systems.
• Own end-to-end architecture for complex AI systems with a focus on maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
• Work with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
• Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
• Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.

Required Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies; or a Master’s degree plus at least 2 years of experience.
• At least 4 years of programming experience with Python, Go, Scala, CUDA, or Java.
• Experience leading development of AI systems with tradeoff decisions involving cost, latency, throughput, and accuracy.
• 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
• Experience designing, developing, delivering, and supporting AI services.
• Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and vector databases, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang.
• Experience applying state-of-the-art techniques to optimize training and inference software for improved hardware utilization, latency, throughput, and cost.
• Experience building agentic AI systems and agentic workflows.
• Proficiency in designing distributed systems for model training, evaluation, and online inference at petabyte scale.
• Experience defining AI model governance processes, including producibility, lineage tracking, and automated retention schedules.
• Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms.

Technology Stack

• AWS Ultraclusters
• Huggingface
• VectorDBs
• PyTorch
• AWS, Google Cloud, Azure
• Python, Go, Scala, CUDA, Java, C++, C#, Golang
• GPU, TPU
• Foundation model training, large language model inference
• Agents and multi-agent workflows
• Similarity search
• Guardrails
• Model evaluation
• Experimentation, governance, observability

Compensation

Salary (McLean, VA onsite): USD 197,300 - 225,100 per year.

This role is also eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).

Benefits

• Health insurance
• Financial and other benefits

Team Overview

The Intelligent Foundations and Experiences (IFX) team is centered on bringing Capital One’s AI vision to life. The team partners with stakeholders across the company to advance the state of the art in science and AI engineering, and builds and deploys proprietary solutions that support business value for millions of customers. AI models and platforms developed by IFX enable teams across Capital One to enhance products with responsible and scalable AI for high-leverage impact.