The Senior Databricks Data Engineer role sits within Deloitte's AI and Data practice and focuses on designing, building, and optimizing cloud-based data engineering solutions on Databricks to modernize data platforms, enable analytics and AI use cases, and support data-driven decision making. This is an onsite position in Kansas City, Missouri.

Responsibilities

Advocate and codify best practices for data architecture, integration, and modeling, with documentation and promotion across teams.
Oversee the design, development, and maintenance of robust data pipelines and architectures that support enterprise-scale data needs.
Drive initiatives to enhance data quality, operational efficiency, and scalability of processes.
Evaluate, pilot, and integrate new big data and analytics technologies; lead, coach, and develop teams of data engineers and architects to ensure high-quality project delivery.
Provide governance, security, and compliance guidance tailored to modern cloud data ecosystems.
Communicate complex technical concepts and business value to executives, business leads, and technology teams.
Oversee CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
Deliver clear technical guidance to colleagues and stakeholders.

Requirements

Ability to work independently and collaboratively within a team.
Effective written and verbal communication skills.
Meticulous attention to detail and a commitment to high-quality work product.
Ability to build and sustain professional relationships and lead projects or workstreams.
Proven ability to manage and prioritize multiple tasks in a fast-paced environment.
Strong interpersonal skills and a professional demeanor; capable of meeting deadlines.
Bachelor's degree in Computer Science, Engineering, or a related field.
5+ years of hands-on data engineering experience with a focus on Databricks across AWS, Microsoft Azure, or Google Cloud Platform.
Experience with Lakehouse architectures, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
Background in data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data pipelines, code, and compute resources.
Ability to travel approximately 50% depending on client needs and project requirements.
Limited immigration sponsorship may be available.

Technologies

Databricks
AWS, Microsoft Azure, Google Cloud Platform (GCP)
Lakehouse architecture
Apache Spark
Delta Lake
PySpark
Delta Live Tables
Autoloader
Structured Streaming
Databricks Workflows
Apache Airflow
Unity Catalog
Databricks Lakeflow
Azure DevOps
AWS Code Pipeline
Jenkins
TFS
PowerShell

Benefits

Discretionary annual incentive program

The Wage Range

Salary for this role ranges from USD 137,500 to 193,600 per year. Compensation reflects a variety of factors, including skills, experience, training, and business needs. The stated range is not adjusted for location-specific differentials.

Information for Applicants with a Need for Accommodation

If you require accommodation during the recruitment process, please visit the Deloitte accommodations page at Deloitte assistance for disabled applicants.

Sr Databricks Data Engineer