Data Engineer [214448]
Apache Airflow
AWS
Aws Cloudwatch
Aws Dms
Business Intelligence
Cdc
Change Data Capture
Dashboards
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Modeling
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Transforms
Data Warehouse
Databases
Grafana
Integration
SQL
Streaming Data
Workflow Orchestration
Job Description
Aquent Talent is hiring a Data Engineer for an onsite role in Foster City, CA. In this position, you will help build and evolve manufacturing-operations data infrastructure, turning batch and streaming source systems into reliable analytics-ready datasets with an emphasis on change capture, monitoring, and orchestration.
The work centers on transforming data from SAP, factory-floor systems, supply chain sources, and other industrial inputs into a Medallion lakehouse structure and semantic layers that support reporting and downstream analytical applications.
What you’ll do
- Design and build batch and streaming Change Data Capture (CDC) pipelines from scratch, ingesting manufacturing operations data from SAP (MES, HANA, SLT), on-premises databases, AWS DMS, and industrial sources such as PLCs.
- Build and maintain Bronze, Silver, and Gold (Medallion) layers and dimensional models for manufacturing operations, including unit traceability, work orders, non-conformance reporting, assembly line station results, logistics, and first-pass yield.
- Develop incremental SQL and dbt models, including MERGE/upsert, SCD Type 2, and late-arriving data handling; process semi-structured test and diagnostic payloads using Python and PySpark.
- Monitor pipeline health and data quality and freshness SLAs using AWS CloudWatch alarms, log monitoring, Grafana dashboards, and automated data quality tests.
- Orchestrate workflows using Apache Airflow and manage AWS ingestion infrastructure including S3, IAM, DMS, and Kinesis, with Git-based CI/CD.
- Collaborate cross-functionally to deliver semantic layers that power business intelligence dashboards and downstream analytical applications.
What you bring
- 5 to 10 years of hands-on data engineering experience.
- Proven experience building data pipelines in manufacturing, industrial, automotive, or semiconductor operations.
- Direct hands-on experience with SAP (ERP, MES, HANA, or SLT) and strong understanding of factory-floor concepts such as non-conformances, production testing/diagnostics, yield, work orders, and supply chain logistics.
- Deep, hands-on experience building CDC pipelines from scratch across relational databases and operational or industrial sources.
- Strong proficiency in dimensional modeling, Medallion architecture (Bronze/Silver/Gold), and building semantic layers for analytics.
- Advanced skills in Python, PySpark, and SQL, plus production experience in AWS (S3, DMS, Kinesis, CloudWatch, IAM) and workflow orchestration (Airflow or similar).
Technologies
- Change Data Capture (CDC), SAP, MES, HANA, SLT, AWS DMS, AWS CloudWatch, Grafana, Apache Airflow, S3, IAM, Kinesis
- Git-based CI/CD, Python, PySpark, SQL, dbt, MERGE, SCD Type 2
Preferred
- Production experience with dbt, Amazon Redshift, Databricks, or Grafana.
- Experience structuring lakehouse data to support AI and agentic applications.
Other details
- Location: Foster City, CA (onsite)
- Salary: USD 69 - 76 per hour
- Minimum experience: 5 years
- Work authorization: Applicants must be authorized to work for any employer in the U.S.; Aquent Talent is unable to sponsor or take over sponsorship of an employment Visa at this time.
- Tag: #LI-Onsite