Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI)
Job Description
Capital One seeks a Senior Lead AI Engineer to advance Gen AI Platform Services and Agentic AI initiatives in McLean, VA.
Responsibilities
- Collaborate with a cross functional team of engineers, research scientists, technical program managers, and product managers to deliver AI powered products that transform how associates work and how customers interact with Capital One.
- Design, build, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Utilize a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
- Develop and apply state of the art LLM optimization techniques to improve performance metrics including scalability, cost, latency, and throughput for large scale production AI systems.
- Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields, plus at least 6 years of experience developing AI and ML algorithms or technologies.
- Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields, plus at least 4 years of experience developing AI and ML algorithms or technologies.
- At least 6 years of experience programming with Python, Go, Scala, or Java.
Technologies
- Python
- Go
- Scala
- Java
- AWS Ultraclusters
- Huggingface
- VectorDBs
- Nemo Guardrails
- PyTorch
Preferred Qualifications
- 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience designing, developing, integrating, delivering, and supporting complex AI systems.
- Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
- Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production.
- Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.
Salary, Locations, and Benefits
- Location: McLean, VA (onsite).
- Salary range for McLean, VA: $229,900 - $262,400 for Senior Lead AI Engineer.
- Other listed locations and ranges: New York, NY: $250,800 - $286,200; Cambridge, MA: $229,900 - $262,400; San Francisco, CA: $250,800 - $286,200; San Jose, CA: $250,800 - $286,200. Salaries for other locations will reflect the range for that location.
- Incentives: eligible for performance based incentive compensation, which may include cash bonuses and/or long term incentives.
- Benefits: Capital One offers a comprehensive benefits package including health and financial benefits; details on eligibility vary by status and level.
- Application timeline: role is open to applications for a minimum of 5 business days.
- Compliance: no agencies; Capital One is an equal opportunity employer (EOE, including disability and veteran status) and maintains a drug-free workplace; background checks governed by applicable laws.