Llm Optimization Engineer Jobs

1 job found

2d ago

Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services)

Capital One McLean, VA

McLean, VA

2d ago

$230k - $262k/yr Full time Agentic Ai Ai Ml Artificial Intelligence

Apply Now

Job Description

What Capital One offers

Capital One presents a leadership role with a competitive compensation package and an onsite work setting in McLean, Virginia. The position offers a salary range of USD 229,900 - 262,400 per year and a chance to guide AI platform services that power banking solutions across the organization. You will lead cross functional teams to transform how associates work and how customers interact with Capital One, with the opportunity to influence the long term roadmap for foundational AI systems.

Responsibilities

Collaborate with a cross functional group of engineers, research scientists, technical program managers, and product managers to deliver AI powered products that impact both internal workflows and customer interactions.
Design, develop, test, deploy, and support AI software components covering foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Utilize a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
Invent and apply state of the art LLM optimization techniques to improve scalability, cost, latency, and throughput of large scale production AI systems.
Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.

Technologies

AWS Ultraclusters
HuggingFace
VectorDBs
Nemo Guardrails
PyTorch
Python, Go, Scala, Java, C++, C#

Requirements

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of AI/ML development experience, or a Master's degree in these fields with at least 4 years of experience.
At least 6 years of experience programming with Python, Go, Scala, or Java.
Seven years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
Experience designing, developing, integrating, delivering, and supporting complex AI systems.
Proven ability to lead and mentor an engineering team and influence cross functional stakeholders.
Experience developing AI and ML algorithms or technologies (eg LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
Experience developing and applying state of the art techniques to optimize training and inference software for better hardware utilization, latency, throughput, and cost.
Strong interest in staying current with AI research and applying novel techniques in production when appropriate.
Excellent communication and presentation skills, with the ability to explain complex AI concepts to peers.

Salary ranges by location

Cambridge, MA: 229,900 - 262,400
McLean, VA: 229,900 - 262,400
New York, NY: 250,800 - 286,200
San Francisco, CA: 250,800 - 286,200
San Jose, CA: 250,800 - 286,200
Other locations: actual offer will reflect local pay range

View full job page →

Get Llm Optimization Engineer Jobs alerts

New Llm Optimization Engineer Jobs, daily.