EngineerJobs.io
← Back to all jobs

Job Description

Role Overview

This position focuses on building robust data pipelines in a cloud environment, coordinating with data platforms and source systems to ensure seamless data movement and processing. The role emphasizes scalable ETL/ELT development, operational reliability, and streamlined release management through established CI/CD practices.

Responsibilities

  • Design and scale ETL/ELT pipelines leveraging Azure Databricks notebooks and Synapse scripts to meet performance and reliability targets.
  • Implement standardized logging, error handling, and restartable processing patterns to sustain pipeline resilience.
  • Configure integrations with Azure Data Lake Storage, various source systems, and enterprise data platforms.
  • Architect and maintain CI/CD pipelines and code repositories to automate environment promotion and release management.

Requirements

  • Strong proficiency in Python and SQL.
  • Proven expertise in Azure Databricks and Azure Synapse development.
  • Deep experience with automated deployment strategies, such as Azure DevOps.

Technologies

  • Python
  • SQL
  • Azure Databricks
  • Azure Synapse
  • Azure DevOps
  • Azure Data Lake Storage

Role Purpose

Develop, deploy, and maintain high-performance, cloud-native data pipelines.

Job Details

  • Job Type: Full-time
  • Location: Laurel, MD (onsite)
  • Work Location: In person

Similar Jobs