Data Lakehouse

Data Lakehouse Engineer Jobs

41 jobs found

Today

Lead Data Engineer / Data Architect

Glint Tech Solutions LLC Charlotte, NC

Charlotte, NC

Today

Full time Azure Data Factory Azure Data Lake Storage Azure Synapse Analytics

Apply Now

Job Description

This on-site opportunity in Charlotte, NC focuses on shaping enterprise data strategy and modernizing platforms across architecture modernization, migrations, and cloud-native microservices.

Responsibilities

Design and own enterprise data architecture to support high-volume retail eCommerce operations.
Develop and maintain ETL and ELT pipelines using Azure Data Factory, Synapse Analytics, and Databricks with PySpark.
Model conceptual, logical, and physical data structures for efficient storage and retrieval.
Implement data warehousing approaches such as dimensional modeling, star schemas, Data Mesh, Delta Lakehouse, and Data Vault.
Lead database migrations and microservices migrations toward unified, cloud-native solutions.
Integrate data from databases, APIs, and external providers via API integrations and message queues.
Embed metadata management and governance within cloud-based data platforms.
Guide and mentor cross-functional engineering teams, shaping technical strategy and stakeholder communications.

Requirements

8+ years of overall experience with at least 1 year in an Architect-level role.
3+ years of hands-on Azure Data Factory and Azure Synapse Analytics experience.
Deep Microsoft Azure expertise including Data Lake Storage, Databricks, PySpark, Cosmos DB, and PostgreSQL.
Strong SQL proficiency for complex queries, transformations, and cloud performance tuning.
Experience with Azure MI, Cosmos DB, Analysis Services, and Informix.
Proficiency in Python and Python-based ETL tools.
Shell scripting experience — Bash, Unix, or Windows.
Proven ability to lead teams, define technical strategy, and communicate across organizational levels.

Technologies

Azure Data Factory
Azure Synapse Analytics
Databricks
PySpark
Data Lake Storage
Cosmos DB
PostgreSQL
SQL
Python
Bash
Unix
Windows
Azure MI
Analysis Services
Informix
Elasticsearch
Docker
Kubernetes
Delta Lake
Delta Lakehouse
Data Mesh
Data Vault

Nice-to-have skills

Elasticsearch experience
Docker and Kubernetes familiarity
Performance tuning and pipeline optimization expertise
Azure, Databricks, or relevant cloud certifications

Company overview

Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States and Canada.

View full job page →

1d ago

Sr Databricks Data Engineer

Deloitte New York, NY

New York, NY

1d ago

$116k - $229k/yr Full time Manager Big Data Bigdata

Apply Now

Job Description

Senior Databricks Data Engineer role at Deloitte in New York, onsite.

Responsibilities

Establish and promote best in class data architecture, integration, and modelling practices, with thorough documentation and governance.
Own the design, development, and ongoing maintenance of scalable data pipelines and architectures that meet enterprise data needs.
Lead initiatives to enhance data quality, boost operational efficiency, and improve process scalability.
Provide team and technology leadership by evaluating, piloting, and integrating new big data and analytics tools; mentor and grow data engineers and architects to ensure effective project delivery.
Advise on data governance, security, and compliance strategies tailored to cloud data ecosystems.
Translate technical concepts and business value for executives, business leads, and technology teams.
Drive DevOps and automation through CI/CD practices using Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.

Requirements

Ability to work independently and collaboratively as part of a team
Strong written and verbal communication skills
Meticulous attention to detail and quality of work product
Ability to build and sustain professional relationships
Ability to lead projects or workstreams
Ability to manage and prioritize multiple tasks in a fast paced and dynamic environment
Strong interpersonal skills and professional demeanor
Ability to meet deadlines

Technologies

Databricks
Delta Lake
Apache Spark
PySpark
Delta Live Tables
Autoloader
Structured Streaming
Databricks Workflows
Unity Catalog
Apache Airflow
CI/CD pipelines
Azure DevOps
AWS Code Pipeline
Jenkins
TFS
PowerShell
AWS
Azure
GCP
Databricks Lakeflow

Benefits

Discretionary annual incentive program

The Team

Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team collaborates with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making, enable innovation, and support large-scale transformation. Practitioners work across business and technology functions to tackle complex challenges in data modernization.

Preferred qualifications

Master's degree in Computer Science, Engineering, or a related field
Experience with one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Compensation

Salary range: USD 116,200 - 229,100 per year

View full job page →

3d ago

Data Engineer

SN Cloud Solutions Chicago, IL

Chicago, IL

3d ago

$0k+/yr Full time Python Apache Airflow Azure Data Factory

Apply Now

Job Description

Data Engineer position in Chicago, IL (hybrid) focused on designing, building, and maintaining scalable data pipelines and analytics platforms.

Responsibilities

Design, develop, and optimize ETL and ELT pipelines for large-scale data processing.
Build scalable data solutions using Python, PySpark, and Apache Spark.
Develop and maintain data ingestion frameworks for structured and unstructured data.
Craft and optimize SQL queries, stored procedures, and related database objects.
Consolidate data from multiple sources, including APIs, databases, and cloud storage.
Establish data quality checks, validation, and monitoring mechanisms.
Collaborate with cloud platforms such as AWS, Azure, or GCP.
Construct and maintain data lakes and data warehouses.
Work with data scientists, analysts, and business stakeholders to inform analytics needs.
Automate workflows with orchestration tools such as Apache Airflow.
Troubleshoot production issues and optimize pipeline performance.
Follow Agile/Scrum practices and CI/CD workflows.

Requirements

Azure Data Factory experience with 7+ years (Required).
SQL proficiency with 3+ years (Required).
Data warehousing concepts with 4+ years (Required).
Strong Python and PySpark expertise, with hands-on Apache Spark experience.
Experience developing ETL/ELT processes.
Cloud platform experience across AWS, Azure, or GCP.
Solid knowledge of data modeling and database design.
Experience with Apache Airflow or similar orchestration tools.
Experience with Git, Jenkins, or Azure DevOps.
Experience with both relational and NoSQL databases.
Excellent problem-solving abilities and clear communication skills.

Technologies

Python
PySpark
Apache Spark
SQL
AWS
Azure
GCP
Apache Airflow
Databricks
Kafka
Delta Lake
Snowflake
Redshift
BigQuery
Synapse
Azure Data Factory
Git
Jenkins
Azure DevOps

Benefits

Flexible schedule

Job Details

Job Type: Full-time
Pay: From $50.00 per year
Location: Hybrid remote in Chicago, IL 60618
Experience requirements: Azure Data Factory 7+ years; SQL 3+ years; Data warehouse 4+ years

View full job page →

4d ago

Sr Databricks Data Engineer

Deloitte Dallas, TX

Dallas, TX

4d ago

$116k - $229k/yr Full time Apache Spark Azure Big Data

Apply Now

Job Description

Deloitte's AI and Data practice is seeking a Senior Databricks Data Engineer to design, build, and optimize cloud-based data solutions on Databricks, enabling analytics and AI initiatives across enterprise data platforms.

Location

Dallas, TX onsite

Salary

USD 116,200 - 229,100 per year

Responsibilities

Establish and promote best practices for data architecture, integration, and modeling across projects.
Own the data pipelines and architectures, guiding design, development, and ongoing maintenance to support large-scale enterprise data needs.
Drive data quality, operational efficiency, and scalable processes through targeted initiatives.
Lead evaluation, piloting, and integration of new big data and analytics technologies to keep the organization at the forefront.
Mentor and develop teams of data engineers and architects, supporting technical growth and project delivery success.
Design and implement governance, security, and compliance strategies aligned with modern cloud data ecosystems.
Translate complex technical concepts and business value for executives, business leads, and technology teams.
Oversee DevOps and automation efforts, implementing CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field.
Minimum five years of hands-on data engineering experience focused on Databricks across AWS, Azure, or GCP.
Proficiency with lakehouse architectures, Apache Spark, Delta Lake, cloud-native storage and databases, and distributed compute platforms.
Experience with data warehousing concepts, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loading, and metadata-driven ingestion and data quality frameworks using PySpark.
At least one year leading complex, cross-functional data initiatives and technical teams, with familiarity across Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and optimization of data pipelines, code, and compute resources.
Willingness to travel approximately 50 percent depending on client engagements and sector.
Limited immigration sponsorship may be available.

Technologies

Databricks platform and ecosystem
Cloud providers: AWS, Microsoft Azure, Google Cloud Platform
Delta Lake, Apache Spark, PySpark
Delta Live Tables, Autoloader, Structured Streaming
Databricks Workflows, Apache Airflow, Unity Catalog
Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
Databricks Lakeflow

Benefits

Discretionary annual incentive program based on performance and program rules, with awards contingent on individual and organizational results.

The Team

Deloitte Core AI and Data practice helps clients modernize data platforms, strengthen enterprise data foundations, and scale analytics and AI capabilities across the business. The team designs, engineers, and deploys cloud-based data solutions to improve decision making, enable innovation, and support large-scale transformation. Practitioners collaborate across business and technology functions to address data modernization challenges.

View full job page →

4d ago

Databricks Data Engineer II

Deloitte Boston, MA

Boston, MA

4d ago

$87k - $171k/yr Full time Big Data Cloud Platform Data Analytics

Apply Now

Job Description

At Deloitte’s Boston office, this Databricks data engineering role sits at the intersection of cloud data platforms and advanced analytics. The position centers on designing, building, and optimizing data pipelines and platforms to enable analytics and AI use cases, working with business and technology teams to modernize environments and drive data‑driven decision making. You’ll join Deloitte’s Core AI & Data practice, helping clients strengthen data foundations and scale analytics and AI capabilities across the organization.

Position Details

Location: Boston, MA (onsite)
Salary: USD 86,700 - 170,900 per year
Minimum Experience: 3 years
Education: Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics

Responsibilities

Architect, implement, and sustain data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL
Support modernization of enterprise data platforms by applying cloud-based ingestion, transformation, and storage patterns
Build and run both batch and streaming workflows to support reporting, analytics, and AI use cases
Apply data architecture, integration, and modeling practices to enhance data quality, scalability, and platform performance
Collaborate with client teams and Deloitte colleagues to troubleshoot issues, implement enhancements, and deliver large-scale data transformation programs

Requirements

Ability to work independently and as part of a team
Effective written and verbal communication skills
Meticulous attention to detail and quality of work
Ability to build and sustain professional relationships
Ability to lead projects or workstreams
Strong ability to manage multiple tasks in a fast-paced environment
Strong interpersonal skills and professional demeanor
Ability to meet deadlines
Ability to provide clear guidance to others
Education: Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
Experience: 3+ years in data engineering, ETL development, or data platform engineering
Databricks experience: 2+ years building data pipelines using Apache Spark, Python, and SQL
Cloud experience: Experience with at least one cloud platform (AWS, Azure, or GCP)
Travel: Ability to travel approximately 50% depending on client engagements
Sponsorship: Limited immigration sponsorship may be available

Technologies

Databricks
Apache Spark
Python
SQL
Delta Lake
Databricks Workflows
Unity Catalog
Git
CI/CD pipelines
AWS, Azure, Google Cloud Platform (GCP)

Team

You would be part of Deloitte's Core AI and Data practice, which focuses on strengthening data foundations and expanding analytics and AI capabilities across client organizations. Teams collaborate across business and technology domains to architect, implement, and deploy cloud-native data solutions that empower informed decisions, foster innovation, and support broad-scale transformation.

Accommodation Information

Applicants needing accommodation can find more details at the Deloitte Careers page: Accommodation resources.

View full job page →

5d ago

Staff Data Engineer

Dexcom Remote 🌍 Remote

Remote

5d ago

$129k - $214k/yr Full time Analytics Artificial Intelligence Business Analytics

Apply Now

Job Description

Dexcom is seeking a Staff Data Engineer who will design, implement, and maintain SQL-based data systems that support manufacturing operations. This remote role focuses on optimizing data platforms across MS SQL Server and Google Cloud Platform, collaborating with multiple teams to deliver near real-time data solutions.

Responsibilities

Architect, develop, and sustain SQL database systems to support manufacturing operations.
Tune and monitor MS SQL Server databases, ETL/ELT pipelines, CDC, replication, and GCP BigQuery DBT data models, along with Iceberg archival to ensure high performance and data availability.
Advance data modernization initiatives by promoting database best practices and adopting cutting-edge technologies including AI and MCP.
Develop and maintain monitoring tools and processes to proactively identify and address database issues.
Implement ETL/ELT processes, data warehousing, and replication solutions to provide near real-time data access globally for efficient storage and retrieval.
Collaborate with cross-functional teams to gather requirements, design systems, and implement database solutions such as stored procedures, table and schema designs, data contracts for APIs, and a data dictionary to support manufacturing software systems.
Work with Microsoft SQL Server and GCP stacks, including SSIS, SSRS, Power BI, PolyBase, BigQuery, Datastream, Cloud Storage, BigLake tables for Apache Iceberg, Cloud SQL, and DBT.
Coordinate with R&D, Operations, Process Engineering, Quality Assurance, Contract Manufacturers, and other stakeholders to enable data access for reporting and data integration.
Collaborate with the IT security team to maintain PKI hardware security modules (HSM) for key management and cryptographic operations, assisting in configuration, installation, and ongoing maintenance of PKI HSMs to ensure secure operation.
Document solutions and provide training to DBA teams on common issues and best practices.

Requirements

Ability to prioritize and execute tasks in a high-pressure environment.
Detail oriented with the capability to maintain updated documentation.
Working knowledge of data management and related tools such as Jira, Jama, and Confluence.
Strong English written and spoken communication skills.
Creative problem solver with attention to detail.
Minimum 5 years of experience with Microsoft SQL Server, fluent in SQL Server 2012 or newer.
Some DBA experience or familiarity with DBA best practices and replication.
Nice to have experience with BigQuery, Iceberg, DBT, and open table formats or similar technology; knowledge of VMware and SQL Server 2022.
Nice to have experience with Siemens Camstar.

Technologies

Microsoft SQL Server
SSIS, SSRS
Power BI
PolyBase
BigQuery
DBT
Datastream
Cloud Storage
BigLake
Apache Iceberg
Cloud SQL
AI, MCP
Jira, Jama, Confluence
VMware
Siemens Camstar
SQL Server 2012+

Benefits

Opportunity to contribute to CGM technology as part of the Dexcom community.
Comprehensive benefits program.
Growth opportunities on a global scale.
Career development through in-house learning programs and eligible tuition reimbursement.
An innovative, industry-leading organization dedicated to employees, customers, and communities.

Travel Required

0-5% travel time.

Experience and Education Requirements

Typically requires a Bachelor’s degree in a technical discipline with 8-12 years of related experience, or a Master’s degree with 5-7 years of equivalent industry experience, or a PhD with 2-4 years of experience.

Remote Workplace

Positions are based in a home office. Living within a 75 mile (120 km) radius of a Dexcom site is not required; hybrid arrangements may be available if you are within commuting distance. Flex workplace options may be discussed.

Salary

USD 128,600 - 214,400 per year.

View full job page →

6d ago

Sr Databricks Data Engineer

Deloitte Pittsburgh, PA

Pittsburgh, PA

6d ago

$116k - $229k/yr Full time Apache Airflow Automation Big Data

Apply Now

Job Description

Join Deloitte's AI & Data practice on site in Pittsburgh to help modernize data platforms, enable analytics and AI, and drive measurable business outcomes. This role offers a competitive compensation range of USD 116,200 to 229,100 per year, plus a discretionary annual incentive and a benefits package aligned with the Core Talent Model. You will work in a collaborative, data-driven environment that prizes technical excellence and leadership, with opportunities to shape cloud based data engineering solutions on Databricks.

Benefits

Discretionary annual incentive program
Benefits package aligned with Core Talent Model
Competitive salary range: USD 116,200 – 229,100 per year

Responsibilities

Champion best practices by documenting and promoting superior data architecture, integration, and modeling approaches
Own data pipelines and architectures to support large scale enterprise data needs
Lead efforts to improve data quality, operational efficiency, and process scalability
Evaluate, pilot, and integrate new big data and analytics technologies; lead and develop teams of data engineers and architects
Design and implement governance, security, and compliance strategies for modern cloud data ecosystems
Communicate technical concepts and business value to executives, business leads, and technology teams
Oversee CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
5+ years of hands-on data engineering experience focusing on Databricks on AWS, Azure, or GCP
Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata driven ingestion and data quality frameworks using PySpark
1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources
Ability to travel up to 50% on average based on the work and client needs
Limited immigration sponsorship may be available

Preferred qualifications

Master's degree in Computer Science, Engineering, or a related field
Experience across one or more cloud ecosystems (AWS, Azure, GCP) and associated big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions