AI Engineer 3 (AI Foundations)
Job Description
Build responsible, scalable AI foundations at Capital One as part of the Intelligent Foundations and Experiences (IFX) team. This hybrid role in New York, NY focuses on creating and operating core AI software for foundation model training, LLM inference, agent workflows, evaluation, governance, and observability, using a mix of open source tools and cloud infrastructure.
At Capital One, you will help deliver AI-powered products that support how associates work and how customers interact with the company. You will also have opportunities to shape the technical direction and long term roadmap for foundational AI systems.
What you’ll do
- Partner with cross-functional teams including engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use an Open Source and SaaS stack including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and additional cloud technologies.
- Introduce state-of-the-art foundation model optimization techniques to improve performance, including scalability, cost, latency, and throughput, for production systems.
- Lead development and benchmarking of multi-turn conversational and tool-using agent workflows with measurable performance and safety metrics.
- Implement scalable pipelines for training, fine-tuning, and deploying foundation or domain-specific models across multiple environments.
- Collaborate with research and data engineering teams to curate high-quality datasets and improve model evaluation methodologies.
- Support governance and security work related to model traceability, lineage documentation, and version control of deployed AI assets.
- Mentor junior AI engineers and promote engineering excellence, reproducibility, and responsible experimentation.
Required qualifications
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 3 years of experience developing AI and ML algorithms or technologies, or a Master’s degree in a related field plus at least 1 year of experience developing AI and ML algorithms or technologies.
- At least 3 years of experience programming with Python, Go, Scala, CUDA, or Java.
Additional information
- Technologies: AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure, Python, Go, Scala, CUDA, Java, C++, C#, Golang, foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, observability, retrieval-augmented generation (RAG).
- Hybrid work statement: This role is designated as hybrid. You are expected to adhere to Capital One’s hybrid policy regarding required on-site presence at your designated office location.
- Salary (New York, NY): USD 176,500 - 201,400 per year.
- Incentive compensation: Eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
Benefits
- Comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.
- Incentive compensation eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability and veterans) committed to non-discrimination. Capital One promotes a drug-free workplace. Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.