EngineerJobs.io
← Back to all jobs

Job Description

This Senior Machine Learning Engineer role focuses on building and evolving a large-scale offline data platform and the infrastructure needed to generate training datasets reliably. The position emphasizes batch and stream processing, reproducibility and observability, and scalable, cost-efficient pipeline architecture.

Role Overview

You will design, operate, and continuously improve data pipelines that produce training datasets for machine learning training and experimentation. The work includes integrating pipeline execution with orchestration systems, strengthening dataset validation and monitoring practices, and optimizing performance and resource utilization across distributed compute environments.

Key Responsibilities

  • Develop infrastructure for batch and stream big data processing using technologies such as Flink, Spark, and Ray.
  • Design and operate large-scale data pipelines that generate training datasets for machine learning training and experimentation.
  • Integrate data pipelines with workflow orchestration systems such as Flyte, Airflow, or similar tools to support reliable multi-stage training workflows.
  • Improve reproducibility and observability through dataset validation, monitoring, and automated testing.
  • Optimize performance and resource utilization across distributed compute systems used for data processing.
  • Partner with ML engineers to enable efficient large-scale experimentation and model iteration.
  • Lead architectural improvements to keep offline data pipelines scalable, reliable, and cost-efficient.

Required Qualifications

  • Experience with distributed computing frameworks such as Flink, Spark, and Ray for distributed data processing.
  • Experience building infrastructure for training data generation, dataset preparation, or ML feature pipelines.
  • Experience optimizing big data pipelines and infrastructure for cost efficiency.
  • Strong programming skills in Python with experience in large-scale distributed workloads.
  • Experience with modern data infrastructure including data lakes, warehouses, orchestration systems, and streaming platforms.
  • Strong systems thinking to evaluate performance, scalability, reliability, and cost tradeoffs in distributed systems.
  • Proven ability to lead technical direction and influence architectural decisions across teams without formal authority.

Technology Focus

  • Flink, Spark, Ray
  • Flyte, Airflow
  • Python

Compensation and Location

Bellevue, WA (onsite)

Base salary: USD 165,600 - 273,400 per year.

  • Zone A: $210,300 - $273,400
  • Zone B: $187,200 - $243,300
  • Zone C: $165,600 - $215,200

Beyond base salary, this role may be eligible for equity awards and participation in company incentive plans (such as annual discretionary bonuses or sales commissions). The final offer depends on geographic location, and the candidate’s relevant experience, professional background, and skill set.

Benefits

  • Comprehensive health, life, and disability insurance
  • Commute subsidy
  • Employee stock ownership
  • Competitive retirement/pension plans
  • Generous vacation and personal days
  • Support for new parents through leave and family-care programs
  • Office food snacks
  • Mental Health and Wellbeing programs and support
  • Employee Resource Groups
  • Global Employee Assistance Program
  • Training and development programs
  • Volunteering and donation matching program

Similar Jobs