Databricks Data Engineer
Job Description
Databricks Data Engineer role at Deloitte in Tempe, AZ (onsite) with a salary range of USD 86,700 - 170,900 per year.
Responsibilities
- Design, construct, and manage data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL.
- Support enterprise data platform modernization by implementing cloud-based ingestion, transformation, and storage patterns.
- Develop and operate batch and streaming data workflows to enable reporting, analytics, and AI initiatives.
- Apply data architecture, integration, and modeling practices to enhance data quality, scalability, and performance of the platform.
- Collaborate with client teams and Deloitte colleagues to troubleshoot issues, implement enhancements, and deliver large-scale data transformation programs.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics.
- 3+ years of experience in data engineering, ETL development, or data platform engineering.
- 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and SQL.
- Experience designing data models, data integration patterns, and cloud-based data processing workflows.
- Experience with at least one cloud platform: AWS, Azure, or Google Cloud Platform (GCP).
- Ability to travel approximately 50% of the time, depending on client engagements.
- Limited immigration sponsorship may be available.
Technologies
- Databricks
- Apache Spark
- Python
- Structured Query Language (SQL)
- AWS
- Microsoft Azure
- Google Cloud Platform (GCP)
- Delta Lake
- Databricks Workflows
- Unity Catalog
- Git
Preferred
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Git-based version control and continuous integration/deployment pipelines
- Experience supporting batch and streaming data workloads
- Knowledge of data warehousing, lakehouse architecture, and performance optimization
- Experience enabling analytics or machine learning data pipelines
- Background in consulting or client-facing delivery environments