Full-Stack Azure Data Engineer
Job Description
Role Overview
This position focuses on building robust data pipelines in a cloud environment, coordinating with data platforms and source systems to ensure seamless data movement and processing. The role emphasizes scalable ETL/ELT development, operational reliability, and streamlined release management through established CI/CD practices.
Responsibilities
- Design and scale ETL/ELT pipelines leveraging Azure Databricks notebooks and Synapse scripts to meet performance and reliability targets.
- Implement standardized logging, error handling, and restartable processing patterns to sustain pipeline resilience.
- Configure integrations with Azure Data Lake Storage, various source systems, and enterprise data platforms.
- Architect and maintain CI/CD pipelines and code repositories to automate environment promotion and release management.
Requirements
- Strong proficiency in Python and SQL.
- Proven expertise in Azure Databricks and Azure Synapse development.
- Deep experience with automated deployment strategies, such as Azure DevOps.
Technologies
- Python
- SQL
- Azure Databricks
- Azure Synapse
- Azure DevOps
- Azure Data Lake Storage
Role Purpose
Develop, deploy, and maintain high-performance, cloud-native data pipelines.
Job Details
- Job Type: Full-time
- Location: Laurel, MD (onsite)
- Work Location: In person