Databricks Data Engineer
Artificial Intelligence
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Engineer
Cloud Native
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
Databricks Workflows
ETL
Google Cloud
Informatica
Information Technology (IT)
Programming Languages
Reporting and Analytics
Software Development
Spark
SQL
Job Description
Deloitte is hiring a Data Engineer II on the AI & Data team to design, build, and maintain Databricks-based data pipelines and workflows. The position is based in Dallas, TX (onsite) and supports modernization of enterprise data platforms, including batch and streaming processing for reporting, analytics, and artificial intelligence use cases.
Compensation: USD 86,700 - 170,900 per year. Experience: 3+ years. Education: Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics.
Responsibilities
- Design, build, and maintain data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL.
- Modernize enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns.
- Develop and maintain batch and streaming data workflows supporting reporting, analytics, and AI use cases.
- Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance.
- Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs.
Requirements
- 3+ years of experience in data engineering, extract, transform, load (ETL) development, or data platform engineering.
- 2+ years building data pipelines in Databricks using Apache Spark, Python, and SQL.
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows.
- Experience working with at least one cloud platform: AWS, Microsoft Azure, or Google Cloud Platform (GCP).
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics.
Technologies
- Databricks, Apache Spark, Python, SQL
- Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP)
- Delta Lake, Databricks Workflows, Unity Catalog
- Git-based version control, continuous integration/continuous deployment pipelines
- Lakehouse architecture
Benefits
- You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program.
Preferred
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog.
- Experience using Git-based version control and continuous integration/continuous deployment pipelines.
- Experience supporting batch and streaming data workloads.
- Experience with data warehousing, lakehouse architecture, and performance optimization.
- Experience supporting analytics or machine learning data pipelines.
- Experience supporting work in consulting or client service delivery environments.