Staff AI Engineer
Job Description
Capital One is seeking a Staff AI Engineer to help build responsible, reliable AI systems and a low-latency personalization engine that supports agent-led, stateful experiences across critical banking workflows. This role sits within the Intelligent Foundations and Experiences (IFX) team, where personalization is evolving from a static ranking function into a dynamic memory and context layer for multiple product surfaces.
This position is remote eligible and based in McLean, VA. You will help architect enterprise AI foundations, define model orchestration and routing, and lead technical direction for unifying tooling, observability, and deployment standards across teams.
What you’ll do
- Architect a unified, low-latency personalization engine that models user intent, preferences, and constraints across product verticals without leaking context or compromising privacy.
- Define how long-horizon user state is represented, governed, and injected into real-time agentic planning loops, balancing proactive autonomy with determinism and trust guardrails in financial workflows.
- Partner with cross-functional teams across engineering, research science, technical program management, and product management to deliver AI-powered products for associates and customers.
- Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use an AI technology stack that may include AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related open source and SaaS tools.
- Introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
- Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Set enterprise-wide AI architecture direction by unifying tooling, observability, and deployment standards across teams.
- Own the design and integration of model routing, caching, and orchestration for hybrid and multi-model workloads.
- Champion responsible AI principles, including transparency, reproducibility, and fairness-by-design.
- Drive internal education, mentorship, and best-practice dissemination through architecture councils and AI guilds.
Minimum qualifications
- Education: Master’s Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.
- Experience: 6+ years developing AI and ML algorithms or technologies.
- Programming: At least 8 years programming with Python, Go, Scala, CUDA, or Java.
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
- Python, Go, Scala, CUDA, Java
- Open Source, SaaS
Team context
- The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life.
- As the ecosystem shifts toward agent-led experiences, personalization becomes a dynamic, stateful memory and context layer rather than a simple ranking model.
- The team is building a core personalization service that tailors agentic behavior across both high-discovery workflows (for example, travel booking) and high-precision workflows (for example, paying bills).
Preferred qualifications
- Experience designing AI systems with tradeoffs across cost, latency, throughput, and accuracy.
- 8+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
- Ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
- Experience developing AI and ML algorithms or technologies (LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
- Experience building agentic AI systems and agentic workflows.
- Strong communication and presentation skills for explaining complex AI concepts.
- Experience defining and operationalizing enterprise AI architecture standards, including data pipeline governance, observability, and evaluation frameworks.
- Experience leading federated or multi-cloud AI strategies for resilience, compliance, and compute efficiency.
- Experience influencing research-to-production promotion, including model handoff, evaluation, and productization.
- Experience defining north-star metrics that balance business value, innovation velocity, cost, and ethical responsibility.
- Experience right-sizing models, instance counts, and hardware types for context length and token inputs/outputs.
Remote and hybrid
- Capital One is open to hiring a Remote or Hybrid employee.
- If Hybrid, you are expected to follow Capital One’s hybrid policy regarding required on-site presence.
- If Remote, you are expected to follow Capital One’s Remote Worker Expectations.
Compensation
- Remote (Regardless of Location): $244,700 - $279,200
- McLean, VA: $269,100 - $307,200
- Cambridge, MA: $269,100 - $307,200
- New York, NY: $293,600 - $335,100
- San Francisco, CA: $293,600 - $335,100
- San Jose, CA: $293,600 - $335,100
- Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
Additional information
- Capital One may sponsor employment authorization for qualified applicants.
- Applications are expected to be accepted for at least 5 business days.
- No agencies please.
- Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination.
- Capital One promotes a drug-free workplace.