AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

Capital One is seeking an AI Engineer 4 to help build and deploy responsible, scalable generative AI platform capabilities. This onsite role in New York, NY focuses on end-to-end architecture and production-grade delivery across agentic AI, guardrails, and evaluation, supported by modern AI infrastructure and tooling.

Working within the Intelligent Foundations and Experiences (IFX) team, you will partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One. The team advances state-of-the-art science and AI engineering while building and deploying proprietary solutions at large scale.

What you’ll do

• Partner across engineering, research, program management, and product to deliver AI-powered products that support associate workflows and customer experiences at Capital One.
• Design, develop, test, deploy, and support AI software components spanning foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Use a broad stack of open source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch (and more).
• Introduce advanced foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap for foundational AI systems.
• Own end-to-end architecture for complex AI systems with a focus on maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
• Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
• Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
• Mentor Principal and Senior Associates on scalable design, performance tuning, and translating research to production.

What you’ll need

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 2 years.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
• Experience leading development of AI systems with tradeoffs involving cost, latency, throughput, and accuracy.
• 6+ years of experience deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, delivering, and supporting AI services.
• Experience developing AI and ML algorithms or technologies such as LLM inference, similarity search and vector databases, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
• Experience applying state-of-the-art techniques to optimize training and inference software for better hardware utilization, latency, throughput, and cost.
• Experience building agentic AI systems and agentic workflows.
• Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale.
• Experience defining AI model governance processes including producibility, lineage tracking, and automated retaining schedules.
• Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms.

Tools and technologies

• AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• AWS, Google Cloud, Azure
• Python, Go, Scala, CUDA, Java, C++, C#, Golang
• GPU/TPU, foundation model training, large language model inference
• agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, observability

Role details

• Location: New York, NY (onsite)
• Experience level: 4+ years (minimum)
• Compensation: USD 215,200 - 245,600 per year