Capital One is seeking an AI Engineer 5 in New York, NY (onsite) to build and deploy responsible, scalable AI systems for banking.

Collaborate with cross-functional teams including engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
Design, develop, test, deploy, and support AI software components across the lifecycle, including:
- Foundation model training
- Large language model inference
- Agents and multi-agent workflows
- Similarity search
- Guardrails
- Model evaluation and experimentation
- Governance and observability
Apply Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch, among others.
Drive state-of-the-art foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput.
Develop and execute the long-term technical vision and roadmap for foundational AI systems.
Design, implement, and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
Establish and lead cost-performance governance reviews across AI systems by tracking GPU utilization, model throughput, and inference cost efficiency.
Participate in or lead team design councils or design review boards to maintain technical consistency and adherence to AI engineering standards.
Mentor Principal and Manager-level AI engineers and support cross-domain learning to raise organizational technical maturity.

Education: Bachelor’s Degree or Master’s degree in Computer Science/AI or related fields.
Experience:
- 6+ years developing AI and ML algorithms or technologies with a Bachelor’s Degree, or
- 4+ years developing AI and ML algorithms or technologies with a Master’s degree.
6+ years programming with Python, Go, Scala, CUDA, or Java.

Experience leading AI systems development with tradeoff decisions across cost, latency, throughput, and accuracy.
7+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
Experience designing, developing, delivering, and supporting complex AI systems.
Experience developing AI/ML algorithms or technologies (e.g., LLM inference, similarity search and vector DBs, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang.
Experience applying state-of-the-art optimization techniques for training and inference to improve hardware utilization, latency, throughput, and cost.
Experience building agentic AI systems and agentic workflows.
Ability to stay current with AI research and productionize novel techniques when appropriate.
Excellent communication and presentation skills to explain complex AI concepts to peers.
Experience architecting and integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components into unified pipelines.
Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes.
Demonstrated ability to balance model performance and operational cost using dynamic inference strategies and model compression.
Experience right-sizing models, instance counts, and hardware types based on requirements such as context length and token inputs/outputs.

Eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).

Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being.

Expected to accept applications for a minimum of 5 business days.
No agencies please.
Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
Capital One promotes a drug-free workplace.
Capital One considers for employment qualified applicants with a criminal history in a manner consistent with applicable laws regarding criminal background inquiries.
For accommodation requests: 1-800-304-9102 or [email protected].
For technical support/questions about the recruiting process: [email protected].
Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.
Capital One Financial includes multiple entities; postings in Canada/United Kingdom/Philippines correspond to specific entities.

AI Engineer 5

Job Description