Sr. Azure Data Engineer with Databricks
Azure
Azure Analytics
Azure Data Engineer
Azure Data Factory
Azure Data Lake
Azure Data Platform
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Factory
Data Factory Azure
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Pyspark
Databricks Sql
ETL
Informatica
Microsoft Azure
Reporting and Analytics
Spark
SQL
Job Description
VeeRteq Solutions Inc. is hiring a Sr. Azure Data Engineer with Databricks for a hybrid position in Philadelphia, PA. This role supports enterprise data modernization and analytics initiatives by delivering scalable cloud data pipelines and Lakehouse-based architectures on Azure and Databricks. You will help ensure data is reliable, governed, and ready for business intelligence, reporting, and advanced analytics.
What You’ll Do
- Design, develop, and maintain scalable ETL/ELT pipelines for enterprise data and analytics initiatives.
- Build data ingestion, transformation, and orchestration frameworks using Azure-native technologies.
- Develop and optimize data processing solutions using Databricks and PySpark.
- Implement and maintain Delta Lake and Lakehouse architectures to support modern data platforms.
- Ensure data quality, accuracy, lineage, and reliability across all data assets.
- Conduct root cause analysis and troubleshoot data-related issues.
- Develop and integrate solutions leveraging: Azure Databricks, Azure Data Lake Storage (ADLS Gen2), Azure Data Factory (ADF), Azure Synapse Analytics, and Azure SQL Database.
- Support data migration, modernization, and cloud transformation efforts.
- Optimize performance, scalability, and cost efficiency for cloud-based data platforms.
- Build and maintain logical and physical data models and create curated data layers for BI, reporting, and advanced analytics workloads.
- Partner with business users and data consumers to translate requirements into scalable technical solutions.
- Implement CI/CD for data engineering solutions, including automated deployment and release management processes.
- Develop monitoring, logging, and observability capabilities for data pipelines.
- Follow enterprise data governance and security standards.
- Participate in Agile/Scrum ceremonies such as sprint planning, daily stand-ups, retrospectives, and backlog refinement.
- Collaborate with Product Owners, Architects, QA teams, and business stakeholders; contribute to continuous improvement and engineering best practices.
What You Bring
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
- 7+ years of experience in Data Engineering.
- 5+ years of hands-on experience with Azure data technologies.
- 2+ years of experience in Healthcare, Managed Care, Health Plans, or Payer organizations.
- Strong expertise in: Azure Databricks, Azure Data Lake Storage (ADLS Gen2), Azure Data Factory (ADF), PySpark, Python, SQL, Delta Lake, and Data Modeling.
- Extensive experience building enterprise-scale data pipelines and data integration solutions.
- Strong understanding of Data Warehousing, Data Lake, and Lakehouse concepts.
- Experience with large volumes of structured and unstructured data.
- Experience with Git, CI/CD, and DevOps practices.
- Strong analytical, troubleshooting, and problem-solving skills.
Additional Preferences
- Experience with Claims Data, Membership Data, Provider Data, or Care Management Data.
- Experience with Power BI or other reporting tools.
- Familiarity with FHIR, HL7, or healthcare interoperability standards.
- Experience with Azure DevOps and Infrastructure as Code (IaC).
- Exposure to AI/ML data pipelines and advanced analytics environments.
Similar Jobs
S
