Distinguished AI Engineer

Capital One invites engineers to lead AI initiatives from the Intelligent Foundations and Experiences (IFX) team in New York City. This onsite Distinguished AI Engineer role offers a path to shape how our associates work and how customers interact with Capital One by designing, building, and deploying large scale AI and ML systems with strong governance and production readiness. Compensation ranges from USD 293,600 to 335,100 per year and reflects the senior scope of responsibilities. You will collaborate across a broad spectrum of partners to push the boundaries of AI in a real-world financial services context.

Benefits

• Health benefits
• Financial benefits
• Performance-based incentive compensation (cash bonuses and/or long term incentives)

Team

You will join the Intelligent Foundations and Experiences (IFX) team, a core force in delivering Capital One's AI vision. The team collaborates with partners across the company to advance AI science and engineering, building proprietary solutions that power key products and deliver value to millions of customers. Our models and platforms enable teams to infuse AI into products at scale.

Responsibilities

• Collaborate with a cross-disciplinary group of engineers, researchers, technical program managers, and product managers to deliver AI powered products that transform how colleagues work and how customers engage with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and apply state-of-the-art LLM optimization techniques to improve scalability, cost efficiency, latency, and throughput in production AI systems at scale.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies
• At least 8 years of experience programming with Python, Go, Scala, or Java
• 8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems
• Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level
• Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Passion for staying abreast of the latest AI research and AI systems, and judiciously applying novel techniques in production
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers

Technologies

• Python, Go, Scala, Java, C++, C#,
• AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch