Senior Agentic AI Engineer - Core Platforms

American Express offers competitive base pay, bonus incentives, and robust benefits designed to support your health, finances, and time away. You will work in a hybrid, onsite, or virtual arrangement depending on the role and business need, with access to global on-site wellness centers and free, confidential counseling through the Healthy Minds program. The role also includes 20+ weeks paid parental leave for all parents regardless of gender for pregnancy, adoption, or surrogacy, plus career development and training opportunities.

As a Senior Agentic AI Engineer focused on Core Platforms, you will design and operate evaluation frameworks that help ensure AI and machine learning systems meet enterprise expectations for quality, safety, reliability, compliance, latency, and cost. Your work turns business and governance needs into measurable success criteria and builds evaluation pipelines that combine automated testing with human-in-the-loop review.

Responsibilities

• Design, develop, and maintain evaluation frameworks for LLM, RAG, agentic, and multimodal applications
• Translate business, product, risk, and governance requirements into measurable success criteria
• Build evaluation pipelines, including automated and human-in-the-loop approaches
• Collaborate with cross-functional partners to support enterprise standards for quality, safety, reliability, compliance, latency, and cost
• Design human-in-the-loop and model-based evaluation workflows, including calibration, error analysis, and validation of evaluation quality
• Build evaluation harnesses and automated test pipelines for LLM, RAG, or agentic applications using production-representative datasets
• Integrate evaluation outcomes into CI/CD, release readiness, production monitoring, and governance evidence

Requirements

• 5+ years of experience in software development, including hands-on work in machine learning, AI technologies, and agentic solutions
• Bachelor’s degree in computer science, machine learning, data science, and/or comparable experience; advanced degree preferred
• Knowledge of Python and data processing technologies such as Big Data (Hadoop, Spark)
• Knowledge of natural language processing techniques such as fuzzy wuzzy and models such as BERT and Transformer models
• Advanced knowledge of machine learning techniques and performance optimization
• Strong understanding of AI system architectures, including LLM ecosystems, retrieval systems, orchestration frameworks, and evaluation methodologies
• Experience with software development focused on machine learning, generative AI, Big Data, and prompt engineering
• Experience working with large language models, especially GPT-3.5/4 or similar
• Experience with Python, R, Java, or C++
• Experience deploying AI models and pipelines using machine learning operations tools
• Experience with CI/CD pipelines and containerized deployments
• Experience building and maintaining data pipelines and ETL (extract, transform, load)
• Experience delivering end-to-end AI systems in production with design and operational ownership
• Experience with distributed systems design, scalable APIs, and cloud-native AI infrastructure, including monitoring and optimization
• Advanced expertise in a technical domain and moderate expertise in a new, different technical domain

Benefits

• Competitive base salaries and bonus incentives
• 6% Company Match on retirement savings plan
• Free financial coaching and financial well-being support
• Comprehensive medical, dental, vision, life insurance, and disability benefits
• Flexible working model with hybrid, onsite, or virtual arrangements depending on role and business need
• 20+ weeks paid parental leave for all parents regardless of gender for pregnancy, adoption, or surrogacy
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through the Healthy Minds program
• Career development and training opportunities

Employment Eligibility (United States)

Employment eligibility to work with American Express in the United States is required, and the company will not pursue visa sponsorship for these positions.

US Job Seekers: If the “Know Your Rights” poster link does not work, access it by copying and pasting this URL into a new browser window: https://www.eeoc.gov/poster.

Technologies

• Python
• Big Data (Hadoop, Spark)
• fuzzy wuzzy
• BERT
• Transformer models
• LLMs, including GPT-3.5/4
• R
• Java
• C++
• machine learning operations tools
• continuous integration/continuous deployment (CI/CD)
• containerized deployments
• extract, transform, and load (ETL)
• scalable APIs
• cloud-native AI infrastructure

Location: New York, NY (onsite)

Salary: USD 123,000 - 215,250 per year