EngineerJobs.io
← Back to all jobs

Job Description

Build and lead mission-critical data platforms at SCP Health, where the culture emphasizes collaboration, courage, agility, and respect, along with a strong track record for work-life balance. This onsite role in Lafayette, LA (Corporate HQ) offers competitive compensation and a comprehensive benefits package, including medical, dental, vision, and a 401(k) company match.

SCP Health is seeking a Senior Data Engineer to define and evolve a platform spanning ingestion, transformation, orchestration, and serving. You will own critical data products and operational reliability, lead complex integrations across healthcare data sources, and strengthen governance, data quality, observability, and secure access for regulated information.

What you will do

  • Define and evolve reference architectures and standards across ingestion, transformation, orchestration, and serving (including Snowflake + dbt and adjacent tooling), and lead design reviews that establish guardrails for scalable, secure, observable, and maintainable delivery.
  • Own end-to-end delivery and operational excellence for critical datasets and pipelines supporting revenue cycle, physician scheduling, billing, and performance monitoring, including SLAs/SLOs, error budgets (where applicable), and support models.
  • Lead strategy and implementation for complex multi-facility integrations (EHR extracts, HL7, FHIR, APIs, and flat files) with backfills, reconciliation, and long-term maintainability, plus repeatable onboarding playbooks and reusable patterns.
  • Enforce platform-wide conventions across Bronze/Silver/Gold layers (naming, modeling, testing, documentation, lineage, certification) to align canonical definitions and reduce rework.
  • Serve as an escalation point for major incidents impacting critical pipelines or multiple domains, leading triage, cross-team resolution, blameless post-incident reviews, and systemic fixes (alerting, runbooks, resilience patterns, backlog priorities).
  • Drive Snowflake performance and cost optimization through warehouse/workload design, scheduling, resource monitors, and query tuning, balancing reliability, latency, and consumption while communicating tradeoffs.
  • Architect and implement HIPAA-aligned controls for PHI/PII, including least-privilege RBAC, masking, row/column policies, and auditing, partnering with Security/Compliance on reviews, audits, and remediation.
  • Define and operationalize data quality strategy and observability standards (tests, reconciliation, anomaly detection, freshness and completeness targets) to ensure measurable coverage for critical pipelines and data products.
  • Perform technical discovery, clarify ambiguous requirements, propose options, and align on definitions, acceptance criteria, change impacts, and rollout plans across teams.
  • Mentor Data Engineers I–III through coaching, pairing, and feedback, raising the engineering bar via design/code reviews, reusable libraries/macros, and practical guidance.
  • Improve data CI/CD and release practices (testing gates, automated checks, environment promotion, release strategy, rollback planning) to reduce defects and improve delivery predictability.
  • Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap, identify systemic risks and dependencies, and propose investments to improve scalability, reliability, governance, and team velocity.

What you bring

  • Expert-level ability to design, optimize, and troubleshoot complex SQL workloads, diagnose performance at query and system levels, and define scalable data access and transformation patterns.
  • Deep expertise in Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring, with the ability to coach others using usage and query analytics.
  • Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion.
  • Ability to define canonical models and data products across domains, manage change over time (SCDs), and drive alignment on definitions to reduce ambiguity.
  • Capability to define SLAs/SLOs, design monitoring/alerting and runbooks, lead incident response and postmortems, and drive systemic improvements through problem management.
  • Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet), including reusable onboarding patterns across facilities and domains.
  • HIPAA-aligned design experience for PHI/PII, including least-privilege access models, masking, row/column policies, auditability, and secure sharing.
  • Strong influence and collaboration skills for discovery and design reviews, including clear communication and enablement through documentation, templates, and consistent standards.
  • Ability to identify systemic issues, propose multi-quarter technical plans, evaluate build vs. buy, and sequence work to reduce risk and increase long-term leverage.
  • Clear communication with technical and non-technical partners, with transparent updates on status, risk, and tradeoffs.
  • Bachelor’s degree (BA/BS) in MIS, Computer Science, or a related field, or equivalent education and experience.
  • 8+ years of progressive professional experience in Data Engineering, Analytics Engineering, or a related role, including ownership of production data pipelines and leadership across cross-domain initiatives.
  • 4+ years of hands-on experience building and operating solutions in the Snowflake ecosystem, including performance tuning and practical cost management.
  • Healthcare and Revenue Cycle (RCM) experience and/or integrating clinical data feeds is strongly preferred; experience working with PHI/PII and regulated data is expected.
  • Experience working in an Agile/Scrum environment, including technical leadership and mentoring engineers through design, delivery, and support.
  • HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).
  • Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.

Benefits and work-life support

  • Comprehensive benefits package and competitive compensation
  • Medical, dental, and vision insurance
  • 401(k) plan with a company match
  • Paid time off and holidays
  • Professional development support
  • Employee wellness resources
  • Work-life balance

Additional details

  • Location: Lafayette, LA (onsite); secondary locations include Atlanta, GA and Dallas, TX
  • Compensation: USD 86,539 to 128,101 per year
  • Work environment: professional setting; continuous sitting and computer use; continuous oral and written communication and listening skills; occasional bending, kneeling, lifting, pulling, and pushing up to 10 pounds; minimum travel (when applicable); high level of mental awareness required

Certifications and training

  • Relevant certification or license in Data, Analytics, Cloud, or Security is a plus
  • SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification
  • dbt Analytics Engineering Certification (preferred), with demonstrated production experience
  • HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred)

Technologies you will work with

  • Snowflake, dbt, SQL
  • HL7, FHIR, APIs, EHR extracts, Flat files
  • HIPAA, RBAC
  • JSON, Parquet, CDC

Similar Jobs