General Motors is seeking a Staff Data Engineer to own production data products for autonomous vehicle and ADAS analytics. The role builds Databricks-based pipelines for large raw vehicle telemetry, establishes data quality and governance standards, and connects governed datasets to self-service and agent workflows through APIs and tool interfaces.
Role Scope
You will take responsibility for ingestion through curated, analytics-ready datasets, including silver-to-gold pipelines that support feature-performance reporting, safety workflows, and self-service analysis. The position also drives the production bar through monitoring, alerting, and disciplined release practices, while enabling trustworthy agentic analytics grounded in approved data.
Key Responsibilities
- Own production data products from ingestion through curated, analytics-ready datasets, including silver-to-gold pipelines that feed feature-performance reporting, safety workflows, and self-service analysis.
- Design and operate reliable Databricks pipelines for large raw vehicle telemetry, including decoding, deduplication, ordering, completeness, and handling late or missing data.
- Run the self-service analytics platform from the engineering side, including workspace onboarding, compute, and governed access so partner teams can analyze approved ADAS data without one-off pipelines.
- Define data-quality checks, monitoring, and alerting, and drive issues to resolution before downstream scorecards and investigations are impacted.
- Ship through a standard path using GitHub, Databricks Asset Bundles, automated tests, and a clear dev-to-prod promotion with rollback.
- Model datasets for reuse so scientists, analysts, and product partners can use them without re-discovering lineage, grain, or known quality limits.
- Apply enterprise data governance, including classification, access control, lineage, and privacy constraints on customer and vehicle data.
- Partner cross-functionally with upstream data engineers, scientists, product managers, and safety stakeholders on contracts, feasibility, and production support.
- Mentor senior and mid-level engineers via design review, code review, and incident response, improving the operational readiness of the platform.
- Bring agentic analytics from planning to production capability, including an entity spine that joins vehicle, event, software, and road context, gold datasets for investigation, and expert procedures that an agent can apply.
- Keep agent outputs trustworthy by grounding results in approved data, returning evidence, and evaluating workflows against known cases while enforcing access, privacy, and AI review requirements.
- Connect production analytics to agent workflows through APIs and tool interfaces, including MCP, so investigations, fleet scans, and KPI explanations reuse the same datasets and align with the enterprise agent platform.
Required Qualifications
- 7+ years of experience building and operating production data platforms.
- Bachelorβs degree in computer science, Software Engineering, or a closely related technical field, or equivalent demonstrable professional software engineering experience.
- Deep hands-on experience with Python, SQL, and Spark on a lakehouse such as Databricks.
- Experience designing batch and incremental pipelines that remain correct with late, duplicate, and incomplete source data.
- Experience running production operations including monitoring, alerting, incident response, and cost-aware performance tuning.
- Experience releasing data code through CI/CD, including infrastructure-as-code or bundle-based deployment.
- Experience putting agent or LLM workflows on production data, including multi-source retrieval, tool use, and grounding responses in data.
- Sound judgment on data governance, access control, and sensitive vehicle or customer data.
- Ability to set technical direction for a domain and guide both engineers and non-engineers.
- Strong written and verbal communication, including design docs and production runbooks.
- Automotive, ADAS, or vehicle-telemetry experience.
- Experience working across more than one cloud, especially Azure and GCP.
- Experience building self-service analytics for analysts and scientists who are not on your team.
- Familiarity with Unity Catalog, data contracts, and medallion (bronze, silver, gold) architecture.
- Experience supporting safety or regulatory reporting where incorrect data has real consequences.
- Experience with agent frameworks, MCP or other tool-calling interfaces, and evaluating agent answers against known cases.
- Familiarity with diagnostic or investigative workflows requiring root-cause explanation.
Technologies
- Databricks
- Databricks Asset Bundles
- GitHub
- Python
- SQL
- Spark
- CI/CD
- Infrastructure-as-code
- Unity Catalog
- Medallion (bronze, silver, gold) architecture
- APIs
- MCP
Compensation
- Base salary range: $159,200 - $220,500 per year
- Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
Benefits
- Medical
- Dental
- Vision
- Health Savings Account
- Flexible Spending Accounts
- Retirement savings plan
- Sickness and accident benefits
- Life insurance
- Paid vacation & holidays
- Tuition assistance programs
- Employee assistance program
- GM vehicle discounts
Work Location and Hybrid Requirements
This role is categorized as hybrid. You are expected to report to Warren Global Technical Center or Austin Technical Center three times per week, at minimum (or other frequency dictated by the business if more than 3 days).
Accommodations
General Motors offers opportunities to all job seekers, including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email or call 1-800-865-7580. Include a description of the specific accommodation requested, along with the job title and requisition number of the position for which you are applying.