Data Warehouse Lead Engineer Jobs

1 job found

Today

Lead Cloud Data Engineer

Baptist Health South Florida Miami, FL

Miami, FL

Today

$129k - $167k/yr Full time Backend Developer Apache Airflow Application Security

Apply Now

Job Description

Baptist Health South Florida is seeking a Lead Cloud Data Engineer to partner with multiple teams on designing, building, and maintaining data systems and applications. In this Florida onsite role, you will help deliver scalable, reliable, automated data pipelines and provide production support with adherence to defined service levels, with a strong focus on healthcare data security and compliance.

What you will do

Collaborate closely with cross-functional teams to design, build, and maintain data systems and applications.
Analyze data storage structures and implement performant automated pipelines that are reliable and scalable in a fast-growing data environment.
Apply data modeling principles and modern data platform knowledge to design and implement data pipeline solutions.
Provide production support while adhering to defined SLA(s).
Test and validate deliverables using industry best practices and communicate effectively with peers in technology teams.

Required experience and qualifications

Self-starter with strong organization, problem-solving, and learning skills.
Strong technical skills and demonstrated attention to detail.
Knowledge of data security, compliance, and policies in healthcare services.
Experience testing and validating according to industry best practices, with effective communication to technology peers.
Strong interpersonal skills plus written and oral communication ability across all levels of the organization.
Bachelor’s degree in computer science or related.
At least 10 years with a Bachelors, and at least 8 years with a Masters (recent experience) in data engineering and end-to-end automation of data pipelines.
Strong understanding of relational and NoSQL databases and data structures.
Understanding of data science and business intelligence workflows.
Programming experience ideally in Python and Java.
Experience with large-scale data warehousing and analytics projects, including AWS technologies.
Proven track record of successful written communication, with technical depth and business awareness.
Experience with machine learning toolkits.
Experience in production support and troubleshooting.
10+ years hands-on with modern data platforms (including Snowflake, Redshift).
10+ years hands-on in data warehouse design/architecture with AWS and Data Vault 2.

Additional preferred and platform experience

Experience with dimensional or dimensional modeling, orchestration tools like Airflow and Control-M, and containerization (Docker and Kubernetes).
Experience with CloudFormation and Terraform, plus AWS services such as S3, AWS Glue, Athena, Lake Formation, DynamoDB, DMS, and RDS.
Agile methodology and DevOps process experience.
Modern data integration tools experience such as dbt or Informatica Power Center, including AWS Glue or similar.
3+ years of data modeling, with familiarity with AI/ML and BI tools (a plus).
Big Data Engineering, Python, and SQL.
Healthcare dimensional modeling experience designing star and snowflake schemas for healthcare analytics, clinical quality measures, operational efficiency, and revenue cycle reporting.
Medical ontologies and semantics experience, including mapping internal hospital codes to standardized vocabularies such as ICD-10, SNOMED-CT, LOINC, and RxNorm.
Google Cloud Platform production engineering experience, including GCS, Dataproc, BigQuery, Cloud Run, Cloud Run Functions, and Cloud Composer.
Cloud security and identity experience, including role-based access control with Cloud IAM and securing credentials with GCP Secret Manager, with observance of strict HIPAA rules for PHI.
Python and PySpark experience, including tuning distributed jobs, handling partition skew, and optimizing Spark resource allocation.
dbt experience using dbt Core and/or dbt Cloud, including reusable SQL models, automated testing, and data dictionary documentation.
Workflow orchestration experience using Apache Airflow (Cloud Composer) and enterprise schedulers like Control-M.
Enterprise data governance experience integrating pipelines with Collibra for business glossaries, technical dictionaries, and automated lineage tracking.

Salary and role details

Location: Florida (onsite)
Estimated salary range: USD 128,671 - 167,273 per year, depending on experience
Experience level: 10+ years

Technologies

SQL, Python, Java
AWS: S3, Hadoop, Hive, Redshift, AWS, AWS Glue, Athena, Lake Formation, DynamoDB, DMS, RDS
Snowflake, Data Vault 2
Airflow, Control-M
Docker, Kubernetes, CloudFormation, Terraform
dbt, Informatica Power Center
Healthcare standards: ICD-10, SNOMED-CT, LOINC, RxNorm
GCP: Google Cloud Platform, Google Cloud Storage (GCS), Dataproc, Spark, PySpark, BigQuery, Cloud Run, Cloud Run Functions, Cloud Composer, Cloud IAM, GCP Secret Manager
Security/compliance: HIPAA, PHI
Governance: Collibra

Benefits

Career growth and development opportunities, with clear pathways and ongoing support
Comprehensive health and wellness resources beyond traditional benefits
A wellness program that can help employees eliminate their medical plan deductible, reducing out-of-pocket healthcare costs
Tuition reimbursement to support continued learning and advancement

View full job page →

Get Data Warehouse Lead Engineer Jobs alerts

New Data Warehouse Lead Engineer Jobs, daily.