Databricks Engineer - Data Engineer II
Backend Developer
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
ETL
Informatica
Information Technology (IT)
Pyspark
Software Development
Spark
SQL
Job Description
Deloitte’s AI & Engineering team is hiring a Databricks Engineer II to build and optimize data pipelines on the Databricks Lakehouse platform. This onsite role in Washington, DC combines practical engineering work with data security, governance, and reliability practices, including Unity Catalog controls and CI/CD for Databricks workflows. The salary range for this position is USD 97,700 to 162,800 per year.
What you’ll do
- Develop and optimize data pipelines using Python, PySpark, and SQL on the Databricks Lakehouse platform
- Apply Medallion architecture patterns to organize, transform, and manage data across data layers
- Perform performance tuning for Databricks workloads and SQL queries
- Configure row-level and column-level security, and manage data lineage and data sharing using Unity Catalog
- Implement continuous integration/continuous delivery (CI/CD) and testing processes for Databricks workflows
What you bring
- Bachelor’s degree
- Ability to obtain and maintain the required clearance for this role
- 2+ years of Databricks engineering experience
- 2+ years experience with Python, PySpark, and SQL
- Ability to travel 10–15%, on average, based on work you do and the clients and industries/sectors you serve
- Must be legally authorized to work in the United States without employer sponsorship, now or at any time in the future
Preferred experience
- Experience using Medallion architecture on the Databricks Lakehouse platform
- Experience configuring row-level and column-level security, data lineage, and data sharing in Unity Catalog
- Experience implementing CI/CD and testing processes for Databricks
- Experience with performance tuning in Databricks
How you work
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
Technologies: Python, PySpark, SQL, Databricks Lakehouse platform, Unity Catalog
Similar Jobs
