Deloitte’s AI & Data practice is seeking a Sr Databricks Data Engineer to design, build, and optimize cloud-based data engineering solutions. In this role, you will help drive enterprise-scale transformations by owning data pipeline development, supporting governance and security needs, and partnering with teams to improve reliability, performance, and scalability.
This onsite position is based in Rosslyn, VA, with an estimated salary range of USD 116,200 to 229,100 per year. The role requires 5+ years of hands-on data engineering experience, including a strong Databricks focus.
What you will do
- Champion best practices by establishing, documenting, and promoting strong approaches for data architecture, integration, and modeling.
- Own data pipelines by overseeing the design, development, and maintenance of robust pipelines and data architectures that support large-scale enterprise data needs.
- Drive excellence through initiatives that improve data quality, operational efficiency, and process scalability.
- Lead teams and technology by evaluating, piloting, and integrating new big data and analytics technologies, and by leading, coaching, and developing data engineers and architects.
- Support data governance through consulting, designing, and implementing governance, security, and compliance strategies for modern cloud data ecosystems.
- Communicate across stakeholders by translating technical concepts into business value for executives, business leads, and technology teams.
- Oversee DevOps and automation, including implementation of CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
Key requirements
- Ability to work independently and collaborate within a team.
- Effective written and verbal communication skills.
- Meticulous attention to detail and quality of work product.
- Ability to build and sustain professional relationships.
- Ability to lead projects or workstreams.
- Ability to manage and prioritize multiple tasks in a fast-paced, dynamic environment.
- Strong interpersonal skills and professional demeanor.
- Ability to meet deadlines.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of hands-on data engineering experience focused on Databricks on AWS, Microsoft Azure, or GCP.
- Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
- Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
- 1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources.
- Ability to travel 50% on average.
- Limited immigration sponsorship may be available.
Preferred qualifications
- Master’s degree in Computer Science, Engineering, or a related field.
- Experience across one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services.
- Experience tuning and optimizing performance in Databricks and Apache Spark environments.
- Experience with Databricks Lakeflow.
- Experience with artificial intelligence and machine learning solutions.
Technologies you may work with
- Databricks, Apache Spark, Delta Lake, Lakehouse architecture
- Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP)
- Cloud-native databases, storage solutions, distributed compute platforms
- Data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes
- Incremental data loads, PySpark, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows
- Apache Airflow, Unity Catalog
- Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
- CI/CD pipelines
Compensation and incentives: The reasonable estimate of the current wage range for this role is $116,200 to $229,100. You may also be eligible to participate in a discretionary annual incentive program, subject to program rules and depending on individual and organizational performance.
Benefits and accommodations: To view the associated benefit package, reference Deloitte’s benefits document at https://resources.deloitte.com/:b:/r/sites/dnet-tod-us/Shared Documents/Benefits/USBenefitsJourneyC.... Deloitte is committed to providing reasonable accommodations for people with disabilities. For recruiting-process accommodations, contact the Global Call Center (GCC) at USTalentCICInbox@deloitte.com. Additional information for applicants needing accommodation is available at https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applic....
