Model Observability Engineer Jobs

1 job found

2d ago

AI Engineer 4 (Gen AI Platform Services)

Capital One New York, NY

New York, NY

2d ago

$215k - $246k/yr Full time Agentic Ai Ai Agent Ai Engineer

Apply Now

Job Description

Join Capital One to help build foundational AI systems that power reliable, responsible experiences for associates and customers. In the Intelligent Foundations and Experiences (IFX) team, you will design and deliver AI platform capabilities such as LLM inference, agents, evaluation, governance, observability, and performance optimization for production.

This AI Engineer 4 role is based in New York, NY (hybrid), with a salary range of $215,200 - $245,600 per year. You can also be eligible for performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI).

What you will do

Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how associates work and how customers interact with Capital One.
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Apply open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
Develop and introduce foundation model optimization techniques that improve scalability, cost, latency, and throughput for large-scale production AI systems.
Help shape the technical vision and long-term roadmap for foundational AI systems.
Own end-to-end architecture for complex AI systems, focusing on maintainability, observability, and ethical alignment.
Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
Partner with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
Lead cross-functional technical reviews for new AI deployments, ensuring security, data governance, and compliance standards are met.
Mentor Principal and Senior Associates on scalable system design, performance tuning, and research-to-production translation.

Technologies you may work with

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
Python, Go, Scala, CUDA, Java, C++, C#, Golang
GPU/TPU, Large language model inference, Similarity Search and VectorDBs
Guardrails, Memory, foundation model training, multi-agent workflows

Minimum qualifications

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years developing AI and ML algorithms or technologies, or a Master's degree plus at least 2 years developing AI and ML algorithms or technologies.
At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Team and mission

The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life. The team works across the company to advance the state of the art in science and AI engineering, building and deploying proprietary solutions that are central to the business and deliver value to millions of customers. AI models and platforms empower teams across Capital One to enhance products with responsible, scalable AI for high-leverage impact.

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits designed to support your total well-being.

Hybrid work expectation

This role is designated as a hybrid position. You are expected to adhere to Capital One’s hybrid policy regarding required on-site presence at the designated office location.

Application timeline

This role is expected to accept applications for a minimum of 5 business days.

Other compensation details

In addition to base salary, this role is eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).

View full job page →

Get Model Observability Engineer Jobs alerts

New Model Observability Engineer Jobs, daily.