Capital One is seeking a Sr. Director, AI Engineer to architect and lead responsible, reliable AI systems, including a unified, low-latency personalization engine for agent-led experiences. The role partners across engineering, research, product, and risk to shape enterprise AI strategy, roadmap, and governance.
Team and Mission
The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life. As the organization shifts toward agent-led experiences, personalization must evolve from a traditional ranking approach into a dynamic, stateful memory and context layer. This team builds the core personalization service that tailors agentic behavior across a range of surfaces, including high-discovery workflows (such as travel booking) and high-precision tasks where margin for error is minimal (such as paying bills).
Key Responsibilities
- Architect a unified, low-latency personalization engine that models user intent, preferences, and constraints across disparate product verticals while protecting privacy and preventing context leakage.
- Define representation, governance, and injection of long-horizon user state into real-time agentic planning loops, balancing proactive autonomy for exploratory tasks with strict determinism and trust guardrails in financial workflows.
- Partner with cross-functional stakeholders across engineering, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
- Oversee end-to-end lifecycle of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Make high-judgment build-versus-buy decisions across a stack of Open Source and SaaS technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
- Introduce state-of-the-art foundation model optimization techniques to improve performance, scalability, cost, latency, and throughput for large-scale production AI systems.
- Contribute to Capital One’s technical vision and long-term roadmap for foundational AI systems.
- Attract and retain AI talent, and support personal and professional development through mentoring, coaching, and a culture of learning.
- Define and drive enterprise-wide AI strategy by aligning product, research, risk, and data organizations around shared technical and ethical principles.
- Establish a multi-year roadmap for scalable, reliable, and compliant AI systems to serve as shared enterprise infrastructure.
- Champion Responsible-AI by ensuring ethical, transparent, and explainable model practices are embedded across lines of business.
- Oversee scaling of AI operations, including model lifecycle management, observability, and cost efficiency across hundreds of production use cases.
Requirements
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 10 years developing AI and ML algorithms or technologies; or a Master’s degree in the same fields, plus at least 8 years developing AI and ML algorithms or technologies.
- At least 5 years of people leadership experience.
Preferred Qualifications
- 7+ years of experience managing and leading an engineering team.
- 8+ years deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
- Experience developing AI and ML technologies, including LLM inference, similarity search and VectorDBs, guardrails, and memory, using Python, C++, C#, Java, CUDA, or Golang.
- Experience building agentic AI systems and agentic workflows.
- Strong interest in staying current with AI research and applying novel techniques judiciously in production.
- Excellent communication and presentation skills, including the ability to explain complex AI concepts to peers.
- Demonstrated experience leading leaders and multiple AI engineering organizations across product, platform, and applied research domains.
- Proven success building enterprise-scale AI platforms serving diverse business lines and customer use cases.
- Ability to influence executive leadership on AI investment strategy, organizational design, and risk management priorities.
- Experience establishing external partnerships or contributing thought leadership in AI industry, academia, or open-source communities.
- Ability to right-size models, instance counts, and hardware types based on requirements such as context length and token inputs/outputs.
Technologies
- AWS Ultraclusters
- Huggingface
- VectorDBs
- PyTorch
- Python
- C++
- C#
- Java
- CUDA
- Golang
- AWS
- Google Cloud
- Azure
Location and Compensation
Location: McLean, VA (remote)
- Remote (regardless of location): $286,200 - $326,700
- Cambridge, MA: $314,800 - $359,300
- McLean, VA: $314,800 - $359,300
- New York, NY: $343,400 - $392,000
- San Francisco, CA: $343,400 - $392,000
- San Jose, CA: $343,400 - $392,000
Performance-based incentive compensation may include cash bonus(es) and/or long-term incentives (LTI). Incentives could be discretionary or non-discretionary depending on the plan.
Ideal Candidate Profile
- Expert in context management, recommendation systems, or identity infrastructure, prepared to advance these capabilities for the agentic era.
- Understanding of the difference between predicting what a user wants and safely executing what a user wants to do.
- Background building high-throughput systems, stateful memory architectures, or advanced RAG pipelines with strict data partitioning.
- Skilled at defining unified APIs, aligning stakeholders on system boundaries, and designing for graceful degradation and user trust.
- Ability to interpret scientific publications and translate research into production judiciously.
- Motivation to support team growth through mentoring and coaching, with hands-on leadership when needed.
- Ability to clarify large, undefined problems, dig into root causes, and communicate findings clearly.
- Strong technical foundation in engineering and mathematics, with the capability to identify and exploit optimization opportunities across hardware, software, and AI.
- Resilient approach to forging new paths when the route is unknown.