Azure Data Lake

Azure Data Lake Engineer Jobs

4 jobs found

Today

Senior Data Engineer

Brooksource New York, NY 🇺🇸 Remote

New York, NY

Today

$65 - $85/hr Full time Senior Analytics API

Apply Now

Job Description

Brooksource is seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and architectures that support advanced analytics and business intelligence. This role centers on building robust data frameworks using big data technologies and cloud platforms, with an emphasis on data modeling and reliable data delivery across the organization.

Responsibilities

Architect and optimize enterprise-grade ETL pipelines using Informatica, Talend, Apache Spark, and Apache Hive
Design and maintain scalable data architectures on AWS, Azure Data Lake, and other public cloud environments
Partner with cross-functional teams to capture requirements and translate them into scalable data solutions
Create and implement dimensional data models for data warehousing and analytics
Oversee data integration workflows involving linked data, RESTful APIs, and external sources
Ensure data quality, security, and compliance throughout the data lifecycle
Enable machine learning model deployment by integrating data pipelines efficiently
Leverage SQL, Python, Java, and Bash/Shell scripting to automate and optimize processes
Participate in agile ceremonies and pursue continuous improvement within sprint cycles
Document data workflows and architecture diagrams to support transparency and knowledge sharing

Requirements

Demonstrated experience as a Data Engineer or similar role with emphasis on big data systems and cloud architectures
Deep knowledge of AWS services (S3, Redshift, Glue), Azure Data Lake, Hadoop ecosystem components, and other public cloud offerings
Strong proficiency in SQL databases including Microsoft SQL Server, Oracle, and cloud-native databases
Hands-on ETL/ELT development with tools like Informatica or Talend
Expertise in data modeling techniques, including dimensional modeling for enterprise data warehouses
Proficiency in programming and scripting languages such as Python, Java, VBA, Bash scripting
Experience with business intelligence tools like Looker or similar platforms for reporting and analysis
Understanding of RESTful API integration for linked data access
Analytical capabilities related to database design, query management, model training, and analytics methodologies
Experience working in Agile environments to deliver iterative value in fast-paced settings

Technologies

Informatica
Talend
Apache Spark
Apache Hive
AWS
Azure Data Lake
Hadoop
S3
Redshift
Glue
Microsoft SQL Server
Oracle
SQL
Python
Java
VBA
Bash scripting
Shell Scripting
Looker
RESTful API

Compensation

Pay: $65.00 - $85.00 per hour

Location

New York, NY (Remote)

View full job page →

1d ago

Staff Engineer II - Senior Data Engineer

Western Alliance Bank Phoenix, AZ

Phoenix, AZ

1d ago

Full time Senior Analytics Azure Data Factory

Apply Now

Job Description

Western Alliance Bank invites a Staff Engineer II - Senior Data Engineer to shape the enterprise data platform with emphasis on safety, security, compliance, and reliability. You will lead a centralized data engineering team and partner with data stewards, analysts, engineers, enterprise architects, and business stakeholders to deliver scalable data capabilities.

What you gain in this role includes:

Competitive salaries
Ownership stake in the company
Medical and dental insurance
Time off
Great 401k matching program
Tuition assistance program
Employee volunteer program
Wellness program

Location: Phoenix, AZ on-site (Block 23)

Responsibilities

Design, develop and deploy data engineering solutions using Azure Data Factory, Azure Synapse Analytics, and Azure DevOps to support regulatory reporting and the LFI strategy.
Create reusable data engineering solution designs ready for hand‑off to execution teams, maximizing efficiency by component reuse.
Build ETL and data pipeline capabilities that account for data creation, transformation, storage, archiving, analysis, and sharing across Western Alliance Bank and partner systems.
Implement Azure DevOps CI/CD pipelines for all data solutions in alignment with technical standards.
Apply Test Driven Development to all designed, built, and implemented data solutions.
Lead the implementation of outcomes and designs from Data Governance and Enterprise Architecture.
Oversee migration of multidimensional cubes to tabular models to optimize analytics and performance.
Use Power BI to design, deploy, and visualize tabular cubes for seamless business intelligence.
Conduct data exploration and profiling with tools such as Excel and Informatica.
Actively participate in data architecture decision making.
Provide technical mentorship to team members and other data professionals.
Collaborate with product owners and business stakeholders to understand requirements and operational processes.
Embed built-in quality and compliance-by-design in all data solutions.
Review Azure Data Factory pipelines, Synapse artifacts, and other scripts to ensure deliverables meet quality standards.

Requirements

Bachelor’s degree in engineering or a related field; Master’s or MBA preferred.
7+ years of data engineering experience covering ETL concepts, enterprise data warehouses, database principles, and related tools; strong preference for Azure Data Factory, Azure Synapse Analytics, and/or Databricks.
2+ years designing, implementing, and supporting cloud data solutions with Azure Data Lake, Azure Data Factory, Azure Data Services, Azure Synapse, Azure Logic Apps, and Azure DevOps experience preferred.
Advanced experience with at least one RDBMS and query language (T-SQL, PL/SQL, Spark SQL).
Advanced data modeling skills across conceptual, logical, and physical layers.
Azure certifications such as Fundamentals, Data Engineer, Data Scientist, and/or DevOps Engineer preferred.
Familiarity with data science and analytics tools (SAS, Tableau, Power BI).
Experience with multi-cloud data management and transformation platforms or tools (e.g., Databricks, Snowflake).
Experience in Agile, SAFe, and/or Scrum frameworks preferred.
Experience integrating with data quality, data catalog, and data lineage tools preferred.
Previous leadership experience preferred.
Knowledge of financial services or banking environments preferred.
Strong understanding of regulatory and legal compliance obligations, industry standards, and practices.
Proven ability to lead cross-functional teams and manage multiple projects concurrently, including pipeline development with Azure DevOps.
Strategic thinker with the ability to align projects with organizational goals, motivate teams, and manage risks.
Excellent written and verbal communication skills.
Up to 25% travel may be required.

Technologies we work with

Azure Data Factory
Azure Synapse Analytics
Azure DevOps
Azure Data Lake
Azure Logic Apps
Power BI
Excel
Informatica
Databricks
Snowflake
SAS
Tableau
Azure Data Services
T-SQL
PL/SQL
Spark SQL

View full job page →

2d ago

Data Engineer

Asylon Norristown, PA

Norristown, PA

2d ago

$120k - $160k/yr Full time Python Azure Data Lake Azure Data Lake Storage

Apply Now

Job Description

Asylon is seeking an experienced Data Engineer to design and sustain real-time data streams from a fleet of robots for live monitoring and ML model training.

Responsibilities

Architect and optimize high-throughput, low-latency data pipelines leveraging Azure cloud services and on-prem components, tailored for streaming and time-series workloads.
Capture, manage, and process robot telemetry data such as position, velocity, and battery status.
Build scalable ingestion, storage, and retrieval solutions for high-resolution video and Lidar point cloud data.
Provide streamlined data access to R&D teams for analysis and experimentation.
Partner with software engineers to specify data formats and transmission protocols from robots to the cloud.
Implement resilience for intermittent connectivity and guarantee data completeness across pipelines.

Requirements

Minimum of 3 years of hands-on Data Engineering experience with a strong focus on real-time or streaming data.
Experience with data storage services, including cloud-based options such as Azure Data Lake and self-hosted solutions.
Expert-level proficiency in Python and data query languages.
Experience with streaming data processing frameworks.
Experience with time-series databases.
Bachelor’s degree in a related field.
Experience in Robotics, IoT, or Autonomous Systems domains: 5 years (Required).

Technologies

Azure
Azure Data Lake
Python
Kubernetes

Benefits

401(k)
Dental insurance
Health insurance
Paid time off
Vision insurance

Job Details

Location: Norristown, PA (onsite)
Work arrangement: In person
Employment type: Full-time
Salary: USD 120,000 - 160,000 per year
Schedule: Monday to Friday; weekends as needed

Application Question

Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Yes or No

View full job page →

7d ago

BI & Analytics Analyst/Data Engineer

JSSA Rockville, MD

Rockville, MD

7d ago

Full time Analyst Analytics Azure Data Lake

Apply Now

Job Description

JSSA in Rockville, MD is seeking a hybrid BI and Analytics Analyst/Data Engineer to lead the design, development, and management of data and analytics solutions. The role spans end-to-end analytics from SQL Server data warehouse design to self-service Power BI reporting, partnering with IT business teams and data engineers to convert raw data into trustworthy, actionable insights. This position emphasizes data quality, governance, and enabling stakeholders to make informed care decisions.

Responsibilities

Collaborate with IT business partners and operational leaders to design analyses that reveal opportunities to improve care, assess adherence to clinical best practices, and quantify outcomes.
Help ensure agency data repositories deliver consistent, reusable data by working with key staff to establish, implement, and guide standards and best practices.
Promote best-practice knowledge to business stakeholders to enable self-service analytics rather than IT-driven development.
Own self-service reporting datasets, including DAX measures, data models, and row-level security.
Translate business requirements into clear analytical deliverables, manage stakeholder expectations, and iterate based on feedback.
Monitor report usage and data quality, proactively identifying and resolving issues.
Document data definitions, metric logic, and report lineage to support a data-literate culture within the agency.
Leverage technical tools to query, manipulate, and summarize data from multiple sources.
Assist in designing, developing, maintaining, and updating databases to meet department and organizational needs.
Design and build star schema data warehouse objects in SQL Server, including fact tables, dimension tables, and aggregates.
Develop and maintain T-SQL stored procedures, ETL pipelines, and staging-to-DWH data loads.
Create and own source-to-target mapping documentation for new data domains.
Integrate data from source systems.
Contribute to data quality, pipeline reliability, and warehouse performance optimization.
Support the adoption of self-service analytics by building clean, well-documented datasets.
Document current data architecture, define logical and physical data structures, and establish the agency data blueprint.
Manage and support the data warehouse solution (Wherescape RED), SQL Server, and related components.
Define operational monitoring and alerting tools to ensure end-to-end delivery of trusted, quality data from sources to consumption.
Establish best-practice standards and processes for data automation, orchestration, and transformation.
Identify, design, implement, and manage a master data management solution for client and employee subjects, collaborating with stakeholders to define data quality standards and operational DQ processes.

Requirements

Bachelor’s degree is required; a Master’s degree is highly preferred.
5-7+ years of experience in a BI, analytics, or data engineering role.
Strong proficiency in SQL Server and T-SQL, including stored procedures, window functions, and query optimization.
Hands-on experience building and maintaining Power BI reports and semantic models (DAX, Power Query).
Hands-on experience with Wherescape OLAP solutions; familiarity with Azure Analysis Services, Azure Data Lake, and Azure Synapse Analytics is welcome.
Experience integrating or working with EHR data (reports, APIs, or data exports).
Familiarity with star schema and dimensional modeling concepts; Kimball methodology is a plus.
Python experience for data wrangling, automation, or pipeline scripting.
Experience with Microsoft Master Data Services (MDS), including defining entities and business rules.
Experience with Microsoft Data Quality Services (DQS) and SQL Server Integration Services (SSIS).
Comfortable working across the full analytics stack from raw data to end-user reports.
Strong communication skills, with the ability to explain data concepts clearly to non-technical stakeholders.
Advanced proficiency with Microsoft Office tools (Power BI), SQL, and experience with EMR systems (hospice, home care, and/or mental health) is desirable.

Technologies

SQL Server
T-SQL
Power BI
DAX
Power Query
Wherescape RED
Azure Analysis Service
Azure Data Lake
Azure Synapse Analytics
Microsoft Master Data Services (MDS)
Microsoft Data Quality Services (DQS)
SQL Server Integration Services (SSIS)

Benefits

Competitive salary
Benefits package
Healthy work-life balance
Collaborative team environment
Opportunities for personal growth and professional development

View full job page →

Azure Data Lake Engineer Jobs

Senior Data Engineer

Staff Engineer II - Senior Data Engineer

Data Engineer

BI & Analytics Analyst/Data Engineer

Get Azure Data Lake Engineer Jobs alerts