EngineerJobs.io
← Back to all jobs

Job Description

Join MLB's LAI team in New York on site to build production data pipelines using Airflow and dbt on Google Cloud Platform. You will design pipelines, data models, and infrastructure that power analytics across clubs and the Commissioner's Office. This role offers a collaborative culture, emphasis on data quality and governance, and the opportunity to influence league analytics with hands-on engineering work.

Responsibilities

  • Develop production-grade pipelines with Airflow and dbt to orchestrate batch and streaming transformations on GCP, delivering trusted data for downstream analysts and engineers.
  • Design clean, layered data models (staging, intermediate, mart) that serve as the league's single source of truth, applying dbt best practices for materialization, testing, and documentation.
  • Operate the ingestion layer with Pub/Sub, GCS, Dataflow, and Knowledge Catalog DataPlex to land both batch and streaming sources into the lakehouse.
  • Establish observability and monitoring standards to surface data quality issues proactively before stakeholders notice them.
  • Manage code through GitHub-based CI/CD, contributing to deployment workflows that keep the platform reliable and changes safe.
  • Adhere to data governance practices to keep proprietary baseball data secure and compliant.

Requirements

  • 2 to 4 years of production data engineering experience.
  • Expert-level SQL, capable of writing complex freehand queries and reviewing others' queries to spot issues.
  • Strong Python skills for data processing, scripting, and automation.
  • Hands-on dbt experience building models across staging, intermediate, and mart layers, with tests and production deployments.
  • Production Airflow experience, including DAG authoring, dependency management, and debugging failed runs.
  • Deep familiarity with Google Cloud Platform (BigQuery, GCS, Pub/Sub) or equivalent depth in AWS/Azure with willingness to convert.
  • Git-based development workflows, including branches, PRs, and code reviews.
  • Clear communication with engineers and non-engineers, receptive to feedback and collaborative in approach.
  • Execution mindset with the ability to own a project from requirements to deployment with minimal oversight.

Technologies

  • Airflow
  • dbt
  • Python
  • SQL
  • GitHub
  • BigQuery
  • GCS
  • Pub/Sub
  • Dataflow
  • Knowledge Catalog DataPlex
  • Terraform

Benefits

  • Competitive Benefits Package
  • Company Contributed 401K Plan
  • Paid Time Off and Holidays
  • Paid Parental Leave
  • Access to Free Tickets to Baseball Games and MLB.TV
  • Discounts at MLB Store
  • Employee Assistance Programs (EAP)
  • Onsite and Online Training and Development Programs
  • Tuition Reimbursement
  • Disability Benefits (short term and long term)
  • Life and Accidental Death Insurance
  • Pet Insurance

Salary

Base salary: $115,000 – $140,000 per year, plus bonus.

NICE-TO-HAVE

  • A degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Experience with Terraform or other Infrastructure-as-Code tools
  • Experience with AI-assisted development or enterprise AI tooling (Gemini Enterprise, Vertex AI)
  • A passion for baseball or prior experience in sports, media, or entertainment
  • Ability to build creative solutions for unusual problems

Similar Jobs