A/B Testing

A/B Testing Engineer Jobs

4 jobs found

13d ago

Machine Learning Engineer

Wonder New York, NY

New York, NY

13d ago

$176k - $260k/yr Full time A/B Testing Artificial Intelligence AWS

Apply Now

Job Description

Wonder is hiring Machine Learning Engineers (Senior through Senior Staff) to take ownership of end-to-end machine learning architecture supporting search ranking, homepage and topic recommendations, retrieval, and query understanding. The role combines technical direction, rigorous evaluation, and cross-team delivery of personalized recommendation and retrieval systems.

Role Overview

You will define system-level design across ranking and recommendation workflows, guide the evolution of optimization objectives, and bring research advancements into production environments. This position also emphasizes improving engineering and operational standards across multiple teams while mentoring engineers and partnering closely with Product and engineering stakeholders.

Key Responsibilities

Own the architecture of the ranking and recommendation stack end to end, including candidate retrieval, multi-objective ranking, calibration, and the ensemble that balances conversion against profitability.
Make cross-system design decisions that require system-wide trade-offs beyond a single model owner.
Lead the evolution of optimization objectives from short-term conversion toward long-term diner value, including offline evaluation and online experimentation to validate results prior to release.
Integrate state of the art information retrieval and recommender systems into runtime, including LLM-driven query and intent understanding, embedding-based retrieval, sequential user representations for cold start, and real-time inference.
Evaluate transfer of approaches to Wonder traffic and discontinue approaches that do not demonstrate value.
Raise engineering and operational standards across teams through model evaluation and scorecards, reproducible training pipelines, safe deployment practices, SLOs and observability for tier-1 models, and proactive technical debt management.
Partner with Product, Search Engineering, Ads, and the Data Platform to shape roadmaps, surface risks early, and ensure data and infrastructure readiness before model needs arise.
Mentor senior and mid-level engineers, participate in hiring, and increase technical depth so critical systems are not dependent on a single person.
Translate technical trade-offs into business terms for product and executive stakeholders and document rationales to preserve decision context over time.
Continuously challenge assumptions and analyze business performance to identify improvements and innovation not yet pursued.

Required Qualifications

MS/PhD in a quantitative discipline such as Computer Science, Math, Physics, Engineering, Statistics, or another technical field, or equivalent experience.
4-8+ years building and shipping machine learning systems.
For staff-level roles: 3+ years operating at a senior-level scope, including setting technical direction across multiple teams, model families, or systems.
Deep experience in recommendation systems, ranking, or information retrieval at scale in production with real latency and cost constraints.
Production deep learning experience with TensorFlow or PyTorch, including training, serving, and tuning runtime models on GPUs.
Experience with Large Language Models and transformer-based architectures, including fine-tuning, embedding generation, and deploying in latency-sensitive applications.
Strong plus: experience with language understanding over imperfect grammar, including real-world search queries and menu or catalog text.
Strong data engineering fundamentals including PySpark, Hive/SQL, the Python data stack, and feature pipelines that can be debugged and built.
Fluency with experimentation, including designing A/B tests, selecting appropriate guardrails, and identifying when offline metrics mislead.
Experience with cloud ML infrastructure such as AWS/SageMaker, model deployment, and production monitoring and observability.
Demonstrated technical leadership through mentoring, driving architecture reviews beyond your own team, and influencing decisions without direct authority.
Ability to communicate performance metrics, model behavior, and technical trade-offs to both technical and non-technical audiences, including executive stakeholders.
Ability to keep up with research publications and synthesize them into production systems.
Deep interest in self-directed continuous learning.

Technologies

TensorFlow
PyTorch
GPUs
Large Language Models
Transformer-based architectures
PySpark
Hive/SQL
Python
AWS
SageMaker
A/B tests

Location and Compensation

Location: New York, NY (onsite)
Salary Range: USD 176,000 - 260,000 per year

Base salary by level (New York):

Senior MLE: $176,000 - $191,000
Staff MLE: $208,500 - $225,000
Senior Staff MLE: $240,000 - $260,000

Benefits

Competitive compensation package with equity
401(k)
Choice of medical, dental, and vision plans
Company paid short and long term disability coverage
Paid time off including flexible time off for exempt employees
Paid vacation for non-exempt employees
Paid sick leave in compliance with applicable law
Paid parental leave
Discounted meals and exclusive perks across the Wonder family of brands

Additional Information

Wonder participates in the federal government's E-Verify program to confirm employment eligibility.
If you need an accommodation during the interview process, notify your recruiter.
Interviews will be scheduled via email or text, and information about your candidacy will be shared accordingly.

View full job page →

25d ago

Machine Learning Engineer 2, Business Platform

Intuit Mountain View, CA

Mountain View, CA

25d ago

$141k - $190k/yr Full time Python A/B Testing Advanced Analytics

Apply Now

Job Description

Intuit seeks a Machine Learning Engineer 2 to join a data science team responsible for conceiving, coding, and deploying data science models at scale. The role emphasizes data preparation, model development and deployment, experimentation through A/B testing and statistical analysis, and the building of agentic systems.

Responsibilities

Identify data sources, obtain access, import datasets, clean and prepare data, and enable datasets to be “machine learning ready”.
Collaborate with data scientists to create and refine features from underlying data and to build pipelines used for training and deployment.
Partner with data scientists to understand, implement, refine, and design machine learning and other algorithms.
Run recurring A/B tests, collect results, conduct statistical analysis, and draw conclusions regarding model impact.
Work cross-functionally with product managers, data scientists, and product engineers, communicating findings to peers and leaders.
Evaluate emerging technology shifts to assess how they may support customer benefits.

Requirements

BS, MS, or PhD degree in Computer Science or a related field (or equivalent work experience).
1+ years of experience.
Working knowledge of data science tools and frameworks, including Python, Scikit, NLTK, Numpy, Pandas, TensorFlow, Keras, R, and Spark.
Basic understanding of machine learning techniques such as classification, regression, and clustering.
Knowledge of machine learning principles including training and validation.
Familiarity with data query and data processing tools, including SQL.
Computer science fundamentals including data structures, algorithms, performance complexity, and how computer architecture influences software performance such as I/O and memory tuning.
Software engineering fundamentals, including version control systems (Git, Github), workflows, and the ability to write production-ready code.
Experience deploying highly scalable software supporting millions or more users.
Experience with GPU acceleration, including CUDA and cuDNN.
Experience integrating applications and platforms with cloud technologies, including AWS and GCP.
Strong oral and written communication skills, including the ability to lead meetings, present professionally, and explain complex technical concepts to non-technical users.

Technologies

Python, Scikit, NLTK, Numpy, Pandas, TensorFlow, Keras, R, Spark
SQL, Git, Github, CUDA, cuDNN
AWS, GCP

Role Overview

The Machine Learning Engineer 2 will be embedded within a data science organization. The position involves helping conceive, code, and deploy data science models at scale using current industry tools. Key focus areas include data wrangling, scaled model deployments, model development, and building agentic systems.

Location and Compensation

Location: Mountain View, CA (onsite). Salary: USD 140,500 to 190,000 per year.

View full job page →

5mo ago

Software Engineer I

StorageMart | MMS Columbia, MO

Columbia, MO

5mo ago Closed

$70k - $100k/yr Full time A/B Testing Algolia API

This position is no longer accepting applications (closed Jul 3, 2026).

Job Description

Software Engineer I in Columbia, MO (hybrid) at StorageMart | MMS offers USD 70,000 - 100,000 per year, as you build and maintain modern web features with Elm while collaborating with cross-functional teams and growing into greater ownership.

Responsibilities

Develop and maintain modern, responsive web features using Elm within our stack.
Collaborate with senior engineers and product owners to translate requirements into practical solutions.
Write clean, well-tested code and actively participate in code reviews, giving and receiving feedback.
Partner with UX designers to translate designs into usable interfaces with attention to detail.
Deploy code confidently with support from teammates and our DevOps team.
Troubleshoot bugs, investigate issues, and contribute to system reliability improvements.
Increase ownership of features and small projects as you grow.
Tackle full-stack work by taking on backend tasks in Node.js, Express, and Postgres as you build confidence.
Help maintain documentation and keep the knowledge base current.

Requirements

1 to 3 years of professional web development experience, including internships and personal projects.
Solid knowledge of HTML, CSS, and JavaScript.
Curiosity about functional programming and a willingness to learn Elm; training is provided.
Exposure to backend concepts such as APIs, databases, or server-side frameworks.
Readable code and a commitment to doing things the right way.
Comfort with asking for help and giving and receiving feedback within a team.
Clear communication and enjoyment of teamwork.
Motivation to grow skills and take on more responsibility over time.
Familiarity with Git and comfort working in a collaborative development workflow.

Technologies

Elm, Node.js, Express, Postgres, HTML, CSS, JavaScript, Git, Haskell, Elixir, OCaml, Algolia, Headless CMSs, A/B testing platforms, CI/CD pipelines

Benefits

Innovative environment that values creativity and technical excellence.
Growth opportunities with mentorship from senior leaders and exposure to new technologies.
Collaborative culture where contributions make a real difference.

Work Hours

Standard business hours with some flexibility, with a strong emphasis on work-life balance.

Work Environment

Hybrid or fully remote arrangement depending on proximity to the Columbia, MO home office.

View full job page →

5mo ago

Software Engineer I

StorageMart | MMS Columbia, MO

Columbia, MO

5mo ago Closed

$70k - $100k/yr Full time Backend Developer A/B Testing Algolia

This position is no longer accepting applications (closed Jul 3, 2026).

Job Description

StorageMart | MMS offers an Innovative Environment, meaningful Growth Opportunities, and a Collaborative Culture in a hybrid role based in Columbia, MO. The Software Engineer I position pays USD 70,000 to 100,000 per year and welcomes candidates with 1 to 3 years of web development experience who are looking to advance into more senior responsibilities.

Benefits

Innovative Environment: A forward‑thinking team that values creativity and technical excellence.
Growth Opportunities: Mentorship from senior leaders and exposure to new technologies.
Collaborative Culture: A supportive setting where your contributions truly matter.

Why you'll love working here

Innovative Environment: Be part of a team that prioritizes creativity and strong technical standards.
Growth Opportunities: Develop your skills and career with guidance from experienced engineers and access to new tech.
Collaborative Culture: Work alongside colleagues who value cooperation and meaningful impact.

Work environment

This position offers hybrid or fully remote options depending on proximity to our home office in Columbia, MO.

Work hours

Standard business hours with some flexibility, and a culture that emphasizes work‑life balance.

Responsibilities

Develop and maintain modern, responsive web features using Elm and the surrounding stack.
Collaborate with senior engineers and product owners to define requirements and deliver solutions.
Write clean, well‑tested code and participate in code reviews, giving and receiving feedback.
Partner with UX designers to translate designs into polished, usable interfaces with attention to detail.
Deploy code with confidence, supported by teammates and the DevOps team.
Debug issues, investigate bugs, and contribute to system reliability improvements.
Take increasing ownership of features and small projects as you grow.
Contribute across the stack by handling backend tasks in Node.js, Express, and Postgres.
Contribute to documentation and keep the knowledge base up to date.

Requirements

1 to 3 years of professional web development experience; internships and personal projects count.
Solid knowledge of HTML, CSS, and JavaScript.
Curious about functional programming and eager to learn Elm; training provided.
Some exposure to backend concepts such as APIs, databases, or server‑side frameworks.
Readable code and a commitment to doing things the right way.
Comfortable asking for help and giving and receiving feedback.
Clear communication and a collaborative mindset.
Motivation to grow skills and take on more responsibility over time.
Familiar with Git and a collaborative development workflow.

Technologies

Elm
Node.js
Express
Postgres
HTML
CSS
JavaScript
Git
Algolia
Headless CMSs
A/B testing platforms

View full job page →

A/B Testing Engineer Jobs

Machine Learning Engineer

Machine Learning Engineer 2, Business Platform

Software Engineer I

Software Engineer I

Get A/B Testing Engineer Jobs alerts