AI Engineer 4 (AI Foundations)

Capital One is hiring an AI Engineer 4 (AI Foundations) role on the Intelligent Foundations and Experiences (IFX) team in New York, NY (onsite). This position focuses on building and deploying responsible, reliable AI systems, spanning foundation model and LLM components, evaluation, governance, and production observability.

On IFX, you will help shape the technical roadmap for foundational AI at Capital One while partnering across engineering, research, technical program management, and product to deliver AI-powered experiences that support associates and customers.

Responsibilities

• Collaborate with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products across Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Work with a mix of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, and VectorDBs, along with PyTorch and related tooling.
• Develop and introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
• Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems, with emphasis on maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
• Partner with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
• Lead cross-functional technical reviews for new AI deployments, ensuring security, data governance, and compliance standards are met.
• Mentor Principal and Senior Associates on scalable system design, performance tuning, and research-to-production translation.

Requirements

• Education and experience: Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies; or Master’s degree plus at least 2 years of experience developing AI/ML algorithms or technologies.
• Programming experience: At least 4 years programming with Python, Go, Scala, CUDA, or Java.

Technologies

• AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• AWS, Google Cloud, Azure
• Python, Go, Scala, CUDA, Java, C++, C#, Golang
• TPU, GPU

Salary and Incentives

• New York, NY: $215,200 - $245,600 per year
• This role is eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI), discretionary or non-discretionary depending on the plan.
• This role is expected to accept applications for a minimum of 5 business days.

Additional Information

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• No agencies please.
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• If you visited the website for employment information and need accommodation, contact Capital One Recruiting at 1-800-304-9102 or [email protected].
• For technical support or questions about the recruiting process, email [email protected].