AI Engineer 4 (AI Foundations)
Job Description
Build responsible, scalable AI systems with the Intelligent Foundations and Experiences (IFX) team at Capital One. This AI Engineer 4 role focuses on taking foundation models and LLM inference from end-to-end architecture through deployment, reliability, and governance, helping power AI capabilities that support millions of customers.
Role location: New York, NY (onsite)
Salary: USD 215,200 - 245,600 per year
Experience: 4+ years (AI/ML development)
Education: Bachelor’s or Master’s degree in Computer Science/AI or a related field
What you’ll do
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how associates work and how customers interact with Capital One.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Work with a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
- Drive state-of-the-art foundation model optimization to improve performance across scalability, cost, latency, and throughput for production AI systems.
- Shape the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Own the end-to-end architecture for complex AI systems, supporting maintainability, observability, and ethical alignment.
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
- Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate inference pipelines.
- Lead cross-functional technical reviews for new AI deployments, ensuring security, data governance, and compliance standards are met.
- Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.
What you bring
- Education and experience: Bachelor’s degree plus at least 4 years of experience developing AI/ML algorithms or technologies, or Master’s degree plus at least 2 years in AI/ML development.
- Programming experience: 4+ years programming with Python, Go, Scala, CUDA, or Java.
Technologies you’ll work with
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
- Python, Go, Scala, CUDA, Java
- AWS, Google Cloud, Azure
- C++, C#, Golang, TPU
Team and mission
The Intelligent Foundations and Experiences (IFX) team is central to bringing Capital One’s AI vision to life. The team advances the state of the art in science and AI engineering while building and deploying proprietary solutions that deliver value to millions of customers. Their AI models and platforms help teams enhance products with responsible, scalable AI for high-leverage impact.
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.
Incentives and timeline
- Incentives: Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
- Application timeline: Expected to accept applications for a minimum of 5 business days.
Additional statements: Capital One will consider sponsoring a new qualified applicant for employment authorization. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet). Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with applicable laws. For accommodation requests, contact Capital One Recruiting at 1-800-304-9102 or [email protected]. For technical support or questions about the recruiting process, email [email protected].