Databricks Data Engineer
Azure
Azure Databricks
Big Data
CI/CD
Cloud
Cloud Platforms
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Database
Databricks
Databricks Workflows
Delta Lake
ETL
Git
Google Cloud
Pyspark
Software Development
Spark
SQL
Job Description
Deloitte is seeking a Databricks Data Engineer to design, build, and optimize cloud-based data engineering solutions that modernize data platforms. You will collaborate with business and technology teams to enable large-scale analytics and AI use cases, delivering measurable business outcomes. The role is onsite in McLean, VA, with a salary range of USD 86,700 to 170,900 per year and requires a bachelor’s degree with at least two years of relevant experience.
Responsibilities
- Develop and sustain data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL.
- Support modernization efforts of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns.
- Create and manage batch and streaming data workflows that support reporting, analytics, and AI initiatives.
- Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance.
- Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
- Minimum of three years of experience in data engineering, ETL development, or data platform engineering
- At least two years of experience building data pipelines in Databricks using Apache Spark, Python, and SQL
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows
- Experience working with at least one cloud platform: AWS, Azure, or GCP
- Ability to travel up to 50% on average based on client work and engagement
- Limited immigration sponsorship may be available
Technologies
- Databricks
- Apache Spark
- Python
- SQL
- AWS, Azure, GCP
- Delta Lake
- Databricks Workflows
- Unity Catalog
- Git
- CI/CD pipelines
Qualifications Required
- Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
- 3+ years of experience in data engineering, ETL development, or data platform engineering
- 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and SQL
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows
- Experience with at least one cloud platform: AWS, Azure, or GCP
- Ability to travel up to 50% on average based on client work and engagements
- Limited immigration sponsorship may be available
Preferred
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Experience using Git-based version control and CI/CD pipelines
- Experience supporting batch and streaming data workloads
- Experience with data warehousing, lakehouse architecture, and performance optimization
- Experience supporting analytics or machine learning data pipelines
- Experience working in consulting or client service delivery environments