Distinguished Machine Learning Engineer

GEICO seeks a Distinguished Machine Learning Engineer to lead the enterprise architecture and strategic direction of its Generative AI and virtual agent platforms. Based in New York, NY and onsite, this senior role provides technical authority across multiple products and business domains to enable production-grade GenAI workflows for more than 20,000 contact center employees.

Responsibilities

• Own and evolve the foundational architecture for GEICO's Generative AI and agentic workflow platforms.
• Serve as the final technical authority on complex architectural decisions impacting multiple products, teams, and business domains.
• Design interconnected, high-performance, durable platform components that power end-to-end GenAI workflows.
• Lead knowledge curation and management.
• Develop and optimize search and retrieval systems.
• Manage prompts and context for GenAI applications.
• Orchestrate workflows and execute actions across platforms.
• Architect semantic and knowledge-graph systems.
• Establish and drive multi-year technical strategy and roadmaps for AI platform capabilities and GenAI applications in close partnership with product and business leaders.
• Balance speed, scalability, reliability, and extensibility while ensuring platforms can support future AI use cases, evolving business needs, and growth.
• Influence investment decisions by evaluating build vs. buy tradeoffs and architectural choices for the platform and GenAI applications.
• Define reference architecture and best practices for GenAI app development, deployment, and integration, aligned with enterprise architecture.
• Collaborate with business stakeholders to identify high-impact GenAI opportunities and strategies to maximize value and measurable outcomes.
• Continuously assess and communicate the business impact of GenAI applications, providing metrics and feedback loops to inform strategy.
• Lead evaluation and selection of core technologies, frameworks, and infrastructure components to support production-ready GenAI, including LLM orchestration (LangChain, LlamaIndex), agentic workflows, RAG systems, and observability tooling.
• Collaborate across engineering, data science, ML, product, and design to align platform and GenAI direction, standards, and business objectives.
• Translate complex technical and business concepts into clear architectural guidance to align teams.
• Partner with senior leaders to promote enterprise-wide GenAI best practices and maximize organizational impact.
• Address the most complex technical and business challenges affecting system-wide and application-specific performance, reliability, and scalability.
• Lead deep technical reviews, architectural assessments, and design discussions for critical AI initiatives.
• Guide platform and GenAI evolution through hands-on engagement when necessary, particularly in high-impact areas.
• Mentor senior engineers and technical leads, setting a high bar for architectural thinking and quality.
• Establish and reinforce best practices for design, reliability, observability, and operational excellence.
• Contribute to internal documentation, architectural standards, and knowledge sharing for the AI platform and GenAI applications.

Requirements

• Master’s degree or higher in Computer Science, Engineering, Statistics, or a related field.
• 10+ years of professional software engineering experience with deep expertise in large-scale distributed systems.
• Extensive experience architecting and building multi-component AI/ML platforms using technologies such as:
  • Search and retrieval systems (Elasticsearch, Qdrant, Milvus, Pinecone, Weaviate)
  • Data platforms (Snowflake, relational and NoSQL databases, and feature stores)
  • Streaming and distributed processing (Kafka, Spark, Ray)
  • Workflow orchestration (Airflow, Temporal, Prefect)
  • LLM orchestration and application frameworks (LangChain, LlamaIndex)
  • Observability, evaluation, and tracing for GenAI systems (LangSmith, Arize Phoenix, Weights & Biases, OpenTelemetry)
  • Vector databases, embedding pipelines, and retrieval-augmented generation (RAG) architectures
  • Agentic frameworks and multi-agent systems for complex task execution
• Strong background in full software development lifecycle ownership, including CI/CD, Kubernetes, monitoring, and production operations.
• Deep experience with major cloud platforms such as AWS and Azure.
• Demonstrated hands-on experience building production systems using LLMs and Generative AI technologies (e.g., GPT, Llama, Mistral, Claude) to power conversational and agentic workflows.

Technologies

• Elasticsearch
• Qdrant
• Milvus
• Pinecone
• Weaviate
• Snowflake
• Relational databases
• NoSQL databases
• Feature stores
• Kafka
• Spark
• Ray
• Airflow
• Temporal
• Prefect
• LangChain
• LlamaIndex
• LangSmith
• Arize Phoenix
• Weights & Biases
• OpenTelemetry
• Kubernetes
• AWS
• Azure
• GPT
• Llama
• Mistral
• Claude

Benefits

• Great Company
• Great Culture
• Great Rewards
• Great Careers
• Competitive pay
• Benefits
• Flexibility to support your well-being and future

The GEICO Pledge

• Great Company: Protecting customers through life’s twists and turns with innovation and integrity.
• Great Careers: Personalized development programs, mentorship, and certification assistance.
• Great Culture: Inclusive and collaborative culture rooted in shared success.
• Great Rewards: Competitive pay, benefits, and flexibility to support your well-being and future.

Annual Salary: USD 210,000 - 350,000 per year