Senior Data Engineer – Microsoft Fabric & Healthcare Integrations

Lead the build and operations of a centralized Microsoft Fabric data platform that integrates healthcare and business systems into trusted analytics-ready datasets.

Responsibilities

• Design and implement the Microsoft Fabric data architecture using OneLake, Lakehouse/Warehouse, Data Factory pipelines, notebooks, and related Fabric capabilities
• Build and maintain ingestion pipelines pulling data from eClinicalWorks, HubSpot, REST APIs, FHIR APIs, webhooks, batch exports, and other future enterprise systems
• Extract source-system data reliably using integration patterns that handle API authentication, pagination, rate limits, schema changes, malformed records, and pipeline failures
• Establish raw, validated, and analytics-ready layers using a medallion-style approach
• Clean, standardize, deduplicate, and reconcile data across systems
• Develop data models for patients, referrals, appointments, providers, procedures, cases, outcomes, and other operational entities
• Implement cross-system matching when identifiers are inconsistent or unavailable, including concepts aligned to Master Patient Index
• Create reusable curated datasets that support Power BI reporting, operational analytics, automation, and future AI applications
• Implement incremental loading, change detection, schema management, error handling, logging, alerting, and pipeline monitoring
• Set up data quality checks to flag incomplete, inconsistent, or unexpected source data
• Apply appropriate security, access controls, and governance practices for healthcare data, aligned with healthcare integration needs
• Use Git with CI/CD so pipelines and transformations are version-controlled, documented, and maintainable
• Monitor Fabric usage, performance, capacity, and cost as the platform scales
• Document architecture, data definitions, pipeline workflows, dependencies, and operating procedures
• Maintain and improve the platform post-launch to add sources and use cases without treating the work as a one-time migration
• Assess current systems, data sources, reporting requirements, and the Microsoft environment; design and configure the initial Microsoft Fabric foundation
• Establish secure and reliable ingestion specifically from HubSpot and eClinicalWorks

Requirements

• 4+ years of professional data engineering, data platform, or data integration experience
• Hands-on experience building production solutions with Microsoft Fabric or a closely related Azure data stack
• Strong SQL skills
• Strong Python and/or PySpark skills
• Experience designing ETL/ELT pipelines and data ingestion frameworks
• Experience with Microsoft Fabric Lakehouse, OneLake, Data Factory/Pipelines, notebooks, Delta tables, or equivalent technologies
• Experience integrating third-party systems through REST APIs
• Experience implementing incremental data loads (not only full refreshes)
• Strong understanding of dimensional modeling, relational modeling, lakehouse architecture, and analytics-oriented data modeling
• Troubleshooting experience across API and ingestion failure modes: authentication, pagination, rate limits, schema changes, malformed records, and pipeline failures
• Experience with Git, source control, and CI/CD practices
• Experience implementing monitoring, logging, data-quality validation, and alerting for production pipelines
• Ability to work independently and make practical architectural decisions while the data platform is still being built
• Healthcare experience is strongly preferred

Technology Focus

• Microsoft Fabric, OneLake, Lakehouse, Warehouse
• Data Factory, Pipelines, Notebooks, Delta tables
• REST APIs, FHIR APIs, Webhooks
• Python, PySpark
• Git, CI/CD, Power BI
• eClinicalWorks, HubSpot, FHIR, HL7
• Microsoft Entra ID, Azure security, Microsoft Purview
• Master Patient Index

Benefits

• 401(k) and 401(k) matching
• Dental insurance
• Health insurance
• Life insurance
• Paid time off
• Vision insurance

Healthcare / Integration Experience (Preferred)

• Healthcare EHR/EMR data
• eClinicalWorks
• FHIR / HL7
• Healthcare operational or clinical data models
• HIPAA-regulated data environments
• Patient identity matching or Master Patient Index concepts
• HubSpot APIs and CRM data
• Microsoft Entra ID and Azure security
• Microsoft Purview or other data governance tools
• Power BI semantic models
• Direct eClinicalWorks experience is a major plus but not required if you have strong healthcare API/FHIR integration experience

Compensation / Location / Employment Details

• Location: Irving, TX (onsite)
• Employment Type: Full-Time
• Work Arrangement: In-Office
• Compensation: $125,000–$150,000 per year depending on experience
• Pay: $125,000.00–$150,000.00 per year
• Work Location: In person

What This Role Is Not

• Not a Power BI developer role with occasional data engineering responsibilities
• Power BI knowledge is useful, but the primary responsibility is building the data infrastructure beneath reporting, analytics, automation, and AI applications