Data Engineer

Aptean is seeking a hands-on Data Engineer to design, build, test, and maintain scalable data ingestion and transformation pipelines on Microsoft Fabric. This role supports enterprise reporting, analytics, and AI initiatives using lakehouse and medallion architecture approaches.

Responsibilities

• Build and maintain ingestion pipelines using Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks) and Azure Data Factory
• Create Python and PySpark notebooks to cleanse, transform, and enrich datasets across medallion layers
• Apply Delta Lake patterns, including partitioning, schema evolution, and incremental loads
• Implement data quality checks such as null handling, duplicate detection, schema validation, and SCD logic
• Develop reusable pipeline frameworks that are metadata-driven and parameterized
• Troubleshoot pipeline failures, performance bottlenecks, and data discrepancies through root-cause analysis
• Participate in code reviews, testing, and CI/CD using Git-based workflows
• Support gold-layer datasets and semantic models for Power BI consumption
• Monitor pipeline runs, address operational issues within defined SLAs, and support on-call rotations as needed
• Maintain technical documentation including data dictionaries, mappings, and runbooks
• Collaborate across teams to deliver reliable, high-quality data engineering solutions

Required Qualifications

• 3–5 years of experience building data pipelines in production or near-production environments
• Hands-on experience with Python and PySpark
• Experience with Azure Data Factory (or equivalent orchestration tools)
• Familiarity with Microsoft Fabric (or strong experience with Azure Synapse/Databricks with willingness to learn Fabric)
• Strong understanding of SQL, data modeling, and performance optimization
• Knowledge of medallion architecture and Delta Lake concepts
• Experience implementing data quality checks and basic SCD handling
• Familiarity with Git, branching, and CI/CD practices (including Azure DevOps or GitHub Actions)
• Strong problem-solving skills, attention to detail, and an ownership mindset
• Effective communication skills and ability to collaborate with technical and business teams

Preferred / Additional Skills

• Exposure to Power BI and semantic data models is a plus
• Understanding of data governance concepts such as schema versioning and access controls is preferred

Technology Stack

• Microsoft Fabric, Azure, Azure Data Factory
• Microsoft Fabric Pipelines, Dataflows Gen2, Notebooks
• Python, PySpark
• Delta Lake
• Power BI
• SQL
• Git, Azure DevOps, GitHub Actions
• Azure Synapse, Databricks

Benefits

• Work with modern data technologies including Microsoft Fabric and Azure
• Collaborative environment with experienced data engineering professionals
• Exposure to enterprise-level data, analytics, and AI initiatives
• Growth opportunities through hands-on learning and ownership of impactful projects

Location & Work Authorization

Alpharetta, GA (onsite). Candidates must be authorized to work in the United States without current sponsorship. Aptean is unable to sponsor work authorization at this time.