EngineerJobs.io
← Back to all jobs

Job Description

Aquent Talent is hiring a Data Engineer for an onsite role in Foster City, CA. In this position, you will help build and evolve manufacturing-operations data infrastructure, turning batch and streaming source systems into reliable analytics-ready datasets with an emphasis on change capture, monitoring, and orchestration.

The work centers on transforming data from SAP, factory-floor systems, supply chain sources, and other industrial inputs into a Medallion lakehouse structure and semantic layers that support reporting and downstream analytical applications.

What you’ll do

  • Design and build batch and streaming Change Data Capture (CDC) pipelines from scratch, ingesting manufacturing operations data from SAP (MES, HANA, SLT), on-premises databases, AWS DMS, and industrial sources such as PLCs.
  • Build and maintain Bronze, Silver, and Gold (Medallion) layers and dimensional models for manufacturing operations, including unit traceability, work orders, non-conformance reporting, assembly line station results, logistics, and first-pass yield.
  • Develop incremental SQL and dbt models, including MERGE/upsert, SCD Type 2, and late-arriving data handling; process semi-structured test and diagnostic payloads using Python and PySpark.
  • Monitor pipeline health and data quality and freshness SLAs using AWS CloudWatch alarms, log monitoring, Grafana dashboards, and automated data quality tests.
  • Orchestrate workflows using Apache Airflow and manage AWS ingestion infrastructure including S3, IAM, DMS, and Kinesis, with Git-based CI/CD.
  • Collaborate cross-functionally to deliver semantic layers that power business intelligence dashboards and downstream analytical applications.

What you bring

  • 5 to 10 years of hands-on data engineering experience.
  • Proven experience building data pipelines in manufacturing, industrial, automotive, or semiconductor operations.
  • Direct hands-on experience with SAP (ERP, MES, HANA, or SLT) and strong understanding of factory-floor concepts such as non-conformances, production testing/diagnostics, yield, work orders, and supply chain logistics.
  • Deep, hands-on experience building CDC pipelines from scratch across relational databases and operational or industrial sources.
  • Strong proficiency in dimensional modeling, Medallion architecture (Bronze/Silver/Gold), and building semantic layers for analytics.
  • Advanced skills in Python, PySpark, and SQL, plus production experience in AWS (S3, DMS, Kinesis, CloudWatch, IAM) and workflow orchestration (Airflow or similar).

Technologies

  • Change Data Capture (CDC), SAP, MES, HANA, SLT, AWS DMS, AWS CloudWatch, Grafana, Apache Airflow, S3, IAM, Kinesis
  • Git-based CI/CD, Python, PySpark, SQL, dbt, MERGE, SCD Type 2

Preferred

  • Production experience with dbt, Amazon Redshift, Databricks, or Grafana.
  • Experience structuring lakehouse data to support AI and agentic applications.

Other details

  • Location: Foster City, CA (onsite)
  • Salary: USD 69 - 76 per hour
  • Minimum experience: 5 years
  • Work authorization: Applicants must be authorized to work for any employer in the U.S.; Aquent Talent is unable to sponsor or take over sponsorship of an employment Visa at this time.
  • Tag: #LI-Onsite

Similar Jobs