EngineerJobs.io
← Back to all jobs
Capital One

Lead AI Engineer (Vision model customization, VLM)

Capital One
New York, NY $215k - $246k/yr Full time Posted 3d ago
Manager Ai Ml Artificial Intelligence Automation Engineering Generative AI Industrial Automation Large Language Models Llm Inference Machine Learning Machine Vision Mechatronics Multimodal Ai Open Source Ai Robotics Technical Lead Vector Databases
Apply Now

Job Description

Capital One is assembling the Intelligent Foundations and Experiences (IFX) team to bring its vision for AI to life. In this Lead AI Engineer role, you will focus on vision model customization and VLM-related work, building and operating AI software components that support foundation model training and production AI capabilities.

This onsite position is based in New York, NY. The compensation range for this role is USD 215,200 - 245,600 per year.

What You’ll Do

  • Work with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that shape how associates work and how customers interact with Capital One.
  • Design, develop, test, deploy, and support AI software components spanning foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Apply a broad stack of open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
  • Introduce state-of-the-art LLM optimization techniques to improve production performance metrics such as scalability, cost, latency, and throughput.
  • Support the technical vision and contribute to the long term roadmap for foundational AI systems at Capital One.

Required Qualifications

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 4 years of experience developing AI and ML algorithms or technologies; or Master’s degree plus at least 2 years of experience developing AI and ML algorithms or technologies.
  • At least 4 years of experience programming with Python, Go, Scala, or Java.

Technologies

  • AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
  • Python, Go, Scala, Java, C++, C#, Golang

Benefits

  • Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
  • Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting overall well-being.

Team Description

The Intelligent Foundations and Experiences (IFX) team is at the center of bringing Capital One’s vision for AI to life.

Preferred Qualifications

  • 6 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or an equivalent private cloud.
  • Experience designing, developing, delivering, and supporting AI services.
  • Experience developing AI and ML algorithms or technologies (for example, LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang.
  • Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
  • Passion for staying abreast of the latest AI research and AI systems, with the ability to judiciously apply novel techniques in production.

Similar Jobs