Senior Quality Data and AI Engineer
Job Description
Join GM’s Quality & Safety Data Platform team to build trustworthy batch and streaming data products, integrate AI into data workflows, and deliver user-facing applications.
Responsibilities
- Design and productionize reliable batch and streaming data products on Azure Databricks using Spark Declarative Pipelines and Delta Lake.
- Use Unity Catalog and Bronze, Silver, Gold patterns to support quality, warranty, and AI application use cases.
- Find and implement opportunities to apply AI across data workflows to improve efficiency, quality, or decision-making.
- Build and maintain data services and APIs that securely expose trusted, well-documented data to applications.
- Develop responsive front-end features using React with JavaScript or TypeScript, following modern web development practices.
- Partner with product designers and stakeholders to turn workflows and data needs into usable interfaces.
- Implement data quality checks, observability, lineage, and alerting; investigate and resolve pipeline and application issues.
- Improve performance, reliability, security, and cost efficiency across data and application systems.
- Apply engineering best practices including code review, automated testing, CI/CD, workload identity, security, cost, observability, and production support.
- Gate agent releases using evaluation of task success, tool use, grounding, latency, and cost.
- Mentor engineers and provide technical guidance; contribute to roadmaps and architectural decisions.
Requirements
- 5+ years of professional experience in data engineering, software engineering, or a closely related field.
- Bachelor’s degree in Computer Science, Software Engineering, Data Science, or related field (or equivalent experience).
- Strong proficiency in SQL, Python, PySpark, plus a data engineering programming language such as Scala or Java.
- Experience designing production-grade ETL/ELT pipelines and working with data warehouses, data lakes, or lakehouse platforms.
- Practical experience using AI tools and services to improve data engineering workflows, with understanding of responsible and secure AI use.
- Hands-on experience building or maintaining front-end applications with React, including familiarity with component-based UI patterns.
- Experience integrating front-end applications with REST or similar APIs, including handling asynchronous data states, errors, and loading behavior.
- Understanding of data modeling, schema evolution, data quality, and distributed processing concepts.
- Strong experience with Databricks on a cloud platform, building and supporting scalable data pipelines.
- Strong communication and problem-solving skills with ability to collaborate across technical and nontechnical teams.
Technologies
- Azure Databricks
- Spark Declarative Pipelines
- Delta Lake
- Unity Catalog
- Bronze, Silver, Gold
- Spark
- React, JavaScript, TypeScript
- SQL, Python, PySpark, Scala, Java
- REST, APIs, ETL, ELT
- CI/CD
Preferred Qualifications
- Experience with tools such as Apache Spark, Kafka, Airflow, or comparable technologies.
- Experience with cloud data platforms such as Snowflake, BigQuery, Redshift, or comparable services.
- Familiarity with Docker, Kubernetes, infrastructure as code, and cloud-native architectures.
- Experience with front-end testing tools, accessibility practices, and design systems.
- Experience implementing authentication, authorization, and secure handling of sensitive data.
- A track record of mentoring teammates and leading delivery across multiple systems or teams.
Compensation
- Base salary (expected): $125,000 - $168,650 per year
- Bonus potential: incentive pay program with payouts based on company performance, job level, and individual performance
- Actual base compensation within the identified range varies based on factors relevant to the position.
Benefits
- Medical, dental, vision
- Health Savings Account
- Flexible Spending Accounts
- Retirement savings plan
- Sickness and accident benefits
- Life insurance
- Paid vacation & holidays
- Tuition assistance programs
- Employee assistance program
- GM vehicle discounts
Accommodations
If you need a reasonable accommodation to assist with your job search or application for employment, email us or call 1-800-865-7580. In your email, include a description of the specific accommodation you are requesting, along with the job title and requisition number.