Databricks Data Engineer
Job Description
Take on the role of a Databricks Data Engineer with Deloitte, embedded in the Core AI & Data practice in Arlington, VA. This on-site position focuses on designing, building, and optimizing cloud-based data solutions with Databricks to enable large-scale transformations, analytics, and AI use cases. The role carries a salary range of USD 86,700 to 170,900 per year and requires a bachelor’s degree along with hands-on experience, starting from two years and up.
Responsibilities
- Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and SQL
- Support the modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns
- Develop and maintain batch and streaming data workflows that support reporting, analytics, and artificial intelligence use cases
- Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance
- Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs
Skills and attributes
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
- 3+ years of experience in data engineering, ETL development, or data platform engineering
- 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and SQL
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows
- Experience working with at least one cloud platform: AWS, Azure, or GCP
- Ability to travel 50% on average, based on the work and clients served
- Limited immigration sponsorship may be available
Technologies
- Databricks
- Apache Spark
- Python
- SQL
- Delta Lake
- Databricks Workflows
- Unity Catalog
- Git-based version control
- CI/CD pipelines
- AWS
- Azure
- GCP
Preferred
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Experience using Git-based version control and CI/CD pipelines
- Experience supporting batch and streaming data workloads
- Experience with data warehousing, lakehouse architecture, and performance optimization
- Experience supporting analytics or machine learning data pipelines
- Experience working in consulting or client service delivery environments
Accommodation information
Information for applicants with a need for accommodation is available at the following page: Accommodation information for disabled applicants.