EngineerJobs.io
← Back to all jobs
Deloitte

Sr Databricks Data Engineer

Deloitte
Morristown, NJ $116k - $229k/yr Full time Posted 7d ago
Big Data Data Architecture Data Engineer Data Governance Data Lake Data Pipeline Data Platform Data Security Data Warehouse Database Databases Databricks Databricks Workflows Spark Technical Lead
Apply Now

Job Description

The Sr Databricks Data Engineer role at Deloitte focuses on designing, building, and optimizing cloud-based data engineering solutions on Databricks to modernize data platforms and enable analytics and AI across the enterprise. This onsite position in Morristown, NJ offers a competitive salary range of USD 116,200 to 229,100 per year and requires a relevant Bachelor's degree and substantial data engineering experience.

Responsibilities

  • Champion best practices: Establish, document, and promote leading approaches for data architecture, integration, and modeling across teams.
  • Pipeline ownership: Oversee the design, development, and ongoing maintenance of robust data pipelines and architectures that support large-scale enterprise data needs.
  • Drive excellence: Lead initiatives to enhance data quality, operational efficiency, and scalability of data processes.
  • Team and technology lead: Evaluate, pilot, and integrate new big data and analytics technologies; mentor and develop teams of data engineers and architects to ensure effective project delivery.
  • Data governance: Advise on and implement governance, security, and compliance strategies within modern cloud data ecosystems.
  • Communication: Translate technical concepts and business value for executives, business leads, and technology teams.
  • DevOps and automation: Oversee CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, and PowerShell to streamline deployments and operations.

Requirements

  • Education: Bachelor's degree in Computer Science, Engineering, or a related field.
  • Experience: 5+ years of hands-on data engineering with a focus on Databricks on AWS, Azure, or GCP.
  • Technical foundations: Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
  • Data modeling and ingestion: Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
  • Leadership scope: 1+ year leading complex, cross-functional data projects and technical teams, with familiarity in Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and optimization of data pipelines, code, and compute resources.
  • Travel: Ability to travel approximately 50% based on client work and engagements.
  • Sponsorship: Limited immigration sponsorship may be available.
  • Minimum experience: 1 year.

Technologies

  • Databricks
  • AWS, Azure, Google Cloud Platform (GCP)
  • Delta Lake, Apache Spark, PySpark
  • Delta Live Tables, Autoloader, Structured Streaming
  • Databricks Workflows, Apache Airflow, Unity Catalog
  • Databricks Lakeflow
  • Azure DevOps, AWS Code Pipeline, Jenkins
  • TFS, PowerShell

Benefits

  • Discretionary annual incentive program

Preferred

  • Advanced degree: Master’s degree in Computer Science, Engineering, or a related field.
  • Cloud experience: Experience across one or more cloud ecosystems (AWS, Azure, GCP) and associated big data services.
  • Performance tuning: Experience tuning and optimizing performance in Databricks and Apache Spark environments.
  • Lakeflow: Experience with Databricks Lakeflow.
  • AI/ML exposure: Experience with artificial intelligence and machine learning solutions.

Similar Jobs