Sr Databricks Data Engineer

The Senior Databricks Data Engineer role sits within Deloitte's AI and Data practice and focuses on designing, building, and optimizing cloud-based data engineering solutions on Databricks to modernize data platforms, enable analytics and AI use cases, and support data-driven decision making. This is an onsite position in Kansas City, Missouri.

Responsibilities

• Advocate and codify best practices for data architecture, integration, and modeling, with documentation and promotion across teams.
• Oversee the design, development, and maintenance of robust data pipelines and architectures that support enterprise-scale data needs.
• Drive initiatives to enhance data quality, operational efficiency, and scalability of processes.
• Evaluate, pilot, and integrate new big data and analytics technologies; lead, coach, and develop teams of data engineers and architects to ensure high-quality project delivery.
• Provide governance, security, and compliance guidance tailored to modern cloud data ecosystems.
• Communicate complex technical concepts and business value to executives, business leads, and technology teams.
• Oversee CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
• Deliver clear technical guidance to colleagues and stakeholders.

Requirements

• Ability to work independently and collaboratively within a team.
• Effective written and verbal communication skills.
• Meticulous attention to detail and a commitment to high-quality work product.
• Ability to build and sustain professional relationships and lead projects or workstreams.
• Proven ability to manage and prioritize multiple tasks in a fast-paced environment.
• Strong interpersonal skills and a professional demeanor; capable of meeting deadlines.
• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of hands-on data engineering experience with a focus on Databricks across AWS, Microsoft Azure, or Google Cloud Platform.
• Experience with Lakehouse architectures, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
• Background in data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
• 1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data pipelines, code, and compute resources.
• Ability to travel approximately 50% depending on client needs and project requirements.
• Limited immigration sponsorship may be available.

Technologies

• Databricks
• AWS, Microsoft Azure, Google Cloud Platform (GCP)
• Lakehouse architecture
• Apache Spark
• Delta Lake
• PySpark
• Delta Live Tables
• Autoloader
• Structured Streaming
• Databricks Workflows
• Apache Airflow
• Unity Catalog
• Databricks Lakeflow
• Azure DevOps
• AWS Code Pipeline
• Jenkins
• TFS
• PowerShell

Benefits

• Discretionary annual incentive program

The Wage Range

Salary for this role ranges from USD 137,500 to 193,600 per year. Compensation reflects a variety of factors, including skills, experience, training, and business needs. The stated range is not adjusted for location-specific differentials.

Information for Applicants with a Need for Accommodation

If you require accommodation during the recruitment process, please visit the Deloitte accommodations page at Deloitte assistance for disabled applicants.