Distinguished AI Engineer (Agentic AI Platform)

Capital One is seeking a Distinguished AI Engineer to spearhead the design and deployment of an enterprise Generative AI Platform featuring agent orchestration, memory, guardrails, and developer tooling. This on-site role in New York, NY collaborates across engineers, research scientists, technical program managers, and product managers to deliver safe, scalable AI-powered products that are used by millions of customers and associates.

Compensation

Salary: USD 293,600 – 335,100 per year

Responsibilities

• Collaborate with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that transform how associates work and how customers interact with Capital One.
• Contribute to the north star platform architecture, producing and refining living diagrams and canonical APIs that cover agent orchestration, RAG pipelines, prompt libraries, and multi-tenant policy enforcement.
• Standardize and automate agentic workflows by evaluating frameworks such as LangGraph, AutoGen, Semantic Kernel, CrewAI, and LlamaIndex, then blend patterns to meet enterprise SLAs so 90% of new apps adopt them.
• Enhance developer experience by helping build an end-to-end GenAI SDK, CLI, and starter kits that allow AI engineers to spin up secure, observable agentic workflows in minutes, cutting prototyping-to-production timelines by about 30%.
• Advance trust and safety through central guardrail services including prompt firewalls, content-filter hooks, red team harnesses, and audit APIs, ensuring zero Sev4 incidents across applications.
• Work with cross-organization architects to optimize orchestration, implement level batching, retrieval caching, and heuristic tuning to reduce per-token spend, while incubating PoCs and RFCs on topics like hierarchical agent memory and multimodal guardrails/RAG.
• Own central Helm charts, operators, and CRDs to auto-scale agents and meet tenant SLAs.
• Coach and evangelize architecture practices by hosting office hours, mentoring staff engineers, authoring design docs and blogs, and representing Capital One at Tier1 AI conferences to broaden platform adoption.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or AI with at least 8 years of experience developing AI and ML algorithms or a Master’s degree with at least 6 years of experience.
• At least 8 years of hands-on programming experience in Python, Go, Scala, or Java.

Technologies

• Python, Go, Scala, Java
• LangGraph, AutoGen, Semantic Kernel, CrewAI, LlamaIndex, LangChain
• Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning
• Kubernetes, Helm, Operators, CRDs

Benefits

• Health benefits
• Financial benefits
• Performance-based incentive compensation (cash bonuses and/or long-term incentives), discretionary or non-discretionary depending on the plan

Team Description

The Intelligent Foundations and Experiences (IFX) team sits at the center of Capital One's AI initiatives, partnering across the company to push the boundaries of AI science and engineering. The team builds and deploys proprietary AI solutions that drive real value for millions of customers, enabling other teams to elevate their products with AI capabilities.

Why This Role Matters

This role shapes an enterprise Generative AI Platform that enables dozens of product teams to assemble powerful, safe, and explainable AI capabilities without getting bogged down in model details or infrastructure. You will design the agentic workflow framework and shared services—memory, guardrails, vector search, SDKs, and blueprints—that translate foundation model power into production-grade applications serving multiple lines of business.