Senior AI Engineer - Customer Agent

Senior AI Engineer on the Klaviyo Customer Agent team in Boston, MA (onsite) designs and builds scalable backend systems and AI agent solutions for an AI-native conversational platform, with a salary range of USD 148,000 - 222,000 per year.

Responsibilities

• Architect and implement backend systems to scale AI capabilities for over 167,000 customers.
• Build robust data collection and processing pipelines for machine learning models used in training and inference.
• Create production-grade services to host and serve AI models with reliability and scalability.
• Advance the agent-centric architecture to boost autonomy and performance of AI agents.
• Foster a culture of ownership, experimentation, and customer-focused product thinking.

Requirements

• 5 to 7 years of professional software engineering experience, emphasizing backend systems and distributed architectures.
• Hands-on experience shipping generative and agentic AI applications to production, with expertise in prompt engineering, few-shot learning, fine-tuning, and evaluation.
• Proven backend engineer with a track record building scalable distributed systems supporting AI agent capabilities.
• Proficient in Python and modern backend frameworks, with Django preferred.
• Experience designing and implementing human and automated evaluations to ensure AI model quality.
• Proficient with big data tools such as Apache Spark and Hadoop.
• Deep experience with asynchronous processing and distributed task queues (Celery, Kafka, SQS, RabbitMQ, Redis).
• Strong understanding of database technologies and ORMs (SQLAlchemy, Alembic).
• Comfortable with cloud-native architectures (AWS) and container orchestration (Kubernetes); capable of managing infrastructure and CI/CD pipelines.
• Skilled in designing and building robust APIs.
• Ability to operate autonomously, handle ambiguity, and thrive in a fast-moving, startup-like environment.
• Curious and committed to staying up to date with rapid advances in the field.
• Comfortable collaborating directly with product managers and customers to shape solutions.

Technologies

• Python
• FastAPI
• Django
• Apache Spark
• Hadoop
• Celery
• Kafka
• SQS
• RabbitMQ
• Redis
• SQLAlchemy
• Alembic
• AWS
• Kubernetes

Benefits

• Annual cash bonus plan
• Variable compensation (OTE) for sales and customer success roles
• Equity
• Sign-on payments
• Health, welfare, and wellbeing benefits

Nice to Have

• Experience training and deploying ML models in production to drive business impact
• Background in reinforcement learning