AI Engineer 3

Capital One is hiring an AI Engineer 3 on the Intelligent Foundations and Experiences (IFX) team to build responsible, reliable AI systems that support associates and customers.

Responsibilities

• Collaborate with cross-functional partners including engineers, research scientists, technical program managers, and product managers to deliver AI-powered experiences.
• Design, develop, test, deploy, and support AI software components such as foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Work with a stack of open source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
• Develop state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
• Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One.
• Lead development and benchmarking of multi-turn conversational and tool-using agent workflows with measurable performance and safety metrics.
• Build scalable pipelines for training, fine-tuning, and deployment of foundation or domain-specific models across multiple environments.
• Partner with research and data engineering teams to curate high-quality datasets and improve model evaluation methodologies.
• Support governance and security work including model traceability, lineage documentation, and version control of deployed AI assets.
• Mentor junior AI engineers and promote engineering excellence, reproducibility, and responsible experimentation.

Requirements

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 3 years of experience developing AI and ML algorithms or technologies, or Master’s degree plus at least 1 year.
• At least 3 years of programming experience with Python, Go, Scala, CUDA, or Java.

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• PyTorch
• Python, Go, Scala, CUDA, Java
• AWS, Google Cloud, Azure
• C++, C#, Golang
• LLM Inference, Similarity Search
• Guardrails, Memory
• Retrieval-augmented generation (RAG)
• Vector database integrations
• Fine-tuning workflows
• Prompt-engineering

Benefits

• Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
• Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being.

Team Description

• The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life.
• Partners across the company to advance state of the art in science and AI engineering and deploy proprietary solutions that support customers at scale.
• Builds and supports AI models and platforms enabling teams to enhance products with responsible, scalable AI.

Preferred Qualifications

• Experience making tradeoff decisions around cost, latency, throughput, and accuracy when building components of AI systems.
• 4+ years deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience developing, delivering, and supporting AI services.
• Experience developing AI and ML algorithms or technologies (including LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang.
• Experience applying state-of-the-art optimization techniques for training and inference software to improve hardware utilization, latency, throughput, and cost.
• Experience building agentic AI systems and agentic workflows.
• Demonstrated ability to evaluate and optimize LLM performance using quantitative metrics (accuracy, coherence, latency, cost).
• Hands-on experience with RAG, vector database integrations, and fine-tuning workflows.
• Experience applying prompt-engineering strategies, safety guardrails, and red-teaming methodologies to production AI systems.

Location and Salary

• Location: McLean, VA (onsite)
• Compensation: USD 161,800 - 184,600 per year

Other Posting Notes

• Applications are expected to be accepted for a minimum of 5 business days.
• No agencies please.
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination.
• Capital One promotes a drug-free workplace.
• For accommodations related to applying on the website: contact Capital One Recruiting at 1-800-304-9102 or [email protected].
• For technical support or questions about recruiting: [email protected].
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through the site.