AI Engineer 4 (Gen AI Platform Services)

Capital One is hiring an AI Engineer 4 (Gen AI Platform Services) for the Intelligent Foundations and Experiences team to build and operate foundation model and GenAI platform capabilities.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers
• Design, develop, test, deploy, and support AI software components such as:
  • foundation model training
  • large language model inference
  • agents and multi-agent workflows
  • similarity search
  • guardrails
  • model evaluation, experimentation
  • governance and observability
• Use open source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related tooling
• Develop state-of-the-art foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput
• Contribute to technical vision and long term roadmap for foundational AI systems
• Own end-to-end architecture for complex AI systems with focus on maintainability, observability, and ethical alignment
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift
• Coordinate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines
• Lead cross-functional technical reviews for new AI system deployments, covering security, data governance, and compliance standards
• Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation

Requirements

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • OR Master’s degree in the same fields plus at least 2 years of experience developing AI and ML algorithms or technologies
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• PyTorch
• AWS
• Google Cloud
• Azure
• Python
• Go
• Scala
• CUDA
• Java
• C++
• C#
• Golang

Benefits

• Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being
• Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

Team Description

• The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
• Partners across the company to advance state of the art in science and AI engineering
• Builds and deploys proprietary solutions central to the business and delivering value to millions of customers
• Empowers teams to enhance products with responsible and scalable AI for high leverage impact

Preferred Qualifications

• Experience leading development AI systems with tradeoff decisions across cost, latency, throughput, and accuracy
• 6+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, delivering, and supporting AI services
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang
• Experience applying state-of-the-art techniques to optimize training and inference software for improved hardware utilization, latency, throughput, and cost
• Experience building agentic AI systems and agentic workflows
• Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale
• Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules
• Ability to influence architectural decisions across multiple AI product lines or platforms

Work Location

• McLean, VA (hybrid)
• Expected to follow Capital One’s hybrid policy for required on-site presence at the designated office location

Compensation

• USD 197,300 - 225,100 per year (McLean, VA)

Application Window

• Expected to accept applications for a minimum of 5 business days