Sr Databricks Data Engineer
Apache Spark
Azure
Big Data
Bigdata
Cloud
Cloud Native
Cloud Platform
Cloud Platforms
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Databricks
Databricks Workflows
Delta Lake
Delta Live Tables
ETL
Google Cloud
Spark
Job Description
Deloitte's AI and Data practice is seeking a Senior Databricks Data Engineer to design, build, and optimize cloud-based data solutions on Databricks, enabling analytics and AI initiatives across enterprise data platforms.
Location
Dallas, TX onsite
Salary
USD 116,200 - 229,100 per year
Responsibilities
- Establish and promote best practices for data architecture, integration, and modeling across projects.
- Own the data pipelines and architectures, guiding design, development, and ongoing maintenance to support large-scale enterprise data needs.
- Drive data quality, operational efficiency, and scalable processes through targeted initiatives.
- Lead evaluation, piloting, and integration of new big data and analytics technologies to keep the organization at the forefront.
- Mentor and develop teams of data engineers and architects, supporting technical growth and project delivery success.
- Design and implement governance, security, and compliance strategies aligned with modern cloud data ecosystems.
- Translate complex technical concepts and business value for executives, business leads, and technology teams.
- Oversee DevOps and automation efforts, implementing CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Minimum five years of hands-on data engineering experience focused on Databricks across AWS, Azure, or GCP.
- Proficiency with lakehouse architectures, Apache Spark, Delta Lake, cloud-native storage and databases, and distributed compute platforms.
- Experience with data warehousing concepts, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loading, and metadata-driven ingestion and data quality frameworks using PySpark.
- At least one year leading complex, cross-functional data initiatives and technical teams, with familiarity across Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and optimization of data pipelines, code, and compute resources.
- Willingness to travel approximately 50 percent depending on client engagements and sector.
- Limited immigration sponsorship may be available.
Technologies
- Databricks platform and ecosystem
- Cloud providers: AWS, Microsoft Azure, Google Cloud Platform
- Delta Lake, Apache Spark, PySpark
- Delta Live Tables, Autoloader, Structured Streaming
- Databricks Workflows, Apache Airflow, Unity Catalog
- Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
- Databricks Lakeflow
Benefits
- Discretionary annual incentive program based on performance and program rules, with awards contingent on individual and organizational results.
The Team
Deloitte Core AI and Data practice helps clients modernize data platforms, strengthen enterprise data foundations, and scale analytics and AI capabilities across the business. The team designs, engineers, and deploys cloud-based data solutions to improve decision making, enable innovation, and support large-scale transformation. Practitioners collaborate across business and technology functions to address data modernization challenges.
Similar Jobs