ETL

ETL Engineer Jobs

514 jobs found

Today

Senior Data Engineer

Brooksource New York, NY 🇺🇸 Remote

New York, NY

Today

$65 - $85/hr Full time Senior Analytics API

Apply Now

Job Description

Brooksource is seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and architectures that support advanced analytics and business intelligence. This role centers on building robust data frameworks using big data technologies and cloud platforms, with an emphasis on data modeling and reliable data delivery across the organization.

Responsibilities

Architect and optimize enterprise-grade ETL pipelines using Informatica, Talend, Apache Spark, and Apache Hive
Design and maintain scalable data architectures on AWS, Azure Data Lake, and other public cloud environments
Partner with cross-functional teams to capture requirements and translate them into scalable data solutions
Create and implement dimensional data models for data warehousing and analytics
Oversee data integration workflows involving linked data, RESTful APIs, and external sources
Ensure data quality, security, and compliance throughout the data lifecycle
Enable machine learning model deployment by integrating data pipelines efficiently
Leverage SQL, Python, Java, and Bash/Shell scripting to automate and optimize processes
Participate in agile ceremonies and pursue continuous improvement within sprint cycles
Document data workflows and architecture diagrams to support transparency and knowledge sharing

Requirements

Demonstrated experience as a Data Engineer or similar role with emphasis on big data systems and cloud architectures
Deep knowledge of AWS services (S3, Redshift, Glue), Azure Data Lake, Hadoop ecosystem components, and other public cloud offerings
Strong proficiency in SQL databases including Microsoft SQL Server, Oracle, and cloud-native databases
Hands-on ETL/ELT development with tools like Informatica or Talend
Expertise in data modeling techniques, including dimensional modeling for enterprise data warehouses
Proficiency in programming and scripting languages such as Python, Java, VBA, Bash scripting
Experience with business intelligence tools like Looker or similar platforms for reporting and analysis
Understanding of RESTful API integration for linked data access
Analytical capabilities related to database design, query management, model training, and analytics methodologies
Experience working in Agile environments to deliver iterative value in fast-paced settings

Technologies

Informatica
Talend
Apache Spark
Apache Hive
AWS
Azure Data Lake
Hadoop
S3
Redshift
Glue
Microsoft SQL Server
Oracle
SQL
Python
Java
VBA
Bash scripting
Shell Scripting
Looker
RESTful API

Compensation

Pay: $65.00 - $85.00 per hour

Location

New York, NY (Remote)

View full job page →

Today

Senior Data Engineer - Technology

Neptune Technology Group Inc. Duluth, GA

Duluth, GA

Today

Full time Senior Amazon Web Services AWS

Apply Now

Job Description

Neptune Technology Group Inc. is seeking a Senior Data Engineer to own and modernize our data pipeline architecture. The role centers on migrating ETL workloads from Redshift stored procedures and legacy SSIS into scalable, maintainable pipelines built with AWS Glue and S3, while guiding the move toward near real-time analytics using stream processing technologies such as Apache Flink and ClickHouse.

This on-site position is based in Duluth, GA.

Responsibilities

Design and build modern ETL/ELT pipelines using AWS Glue, S3, and related services to replace legacy stored procedures and SSIS jobs.
Architect data transformation workflows that are testable, version-controlled, and observable.
Optimize and maintain the Redshift data warehouse, including materialized views, query performance, and cost efficiency.
Drive the evolution from batch ETL to near real-time stream processing, evaluating and implementing technologies such as Apache Flink, ClickHouse, Kafka, Kinesis, or equivalent platforms.
Design pipelines that support both near real-time and batch workloads as the platform transitions.
Partner with product and analytics teams to ensure data models support reporting, AI/ML, and customer-facing features.
Establish patterns and best practices for pipeline development that the broader team can adopt.
Participate in production support and incident response for data infrastructure.

Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. Minimum of 5+ years in data engineering roles.
Deep experience with AWS Glue (PySpark/Python), S3, and Redshift.
Proven track record migrating ETL workloads from legacy tools (SSIS, stored procedures, or similar) to modern cloud-native pipelines.
Strong SQL skills with best practices and SQL linting, particularly in Redshift or other columnar/MPP databases.
Experience with or strong interest in stream processing frameworks (Flink, Spark Streaming, Kafka Streams, or similar).
Familiarity with data pipeline orchestration, monitoring, and error handling patterns.
Experience with infrastructure-as-code and CI/CD for data pipelines.

Technologies

Python
PySpark
SQL
AWS Glue
S3
Redshift
SSIS
Apache Flink
ClickHouse
Kafka
Kinesis
Apache Spark Streaming
Kafka Streams
Aurora MySQL
DynamoDB
Apache Druid
dbt
Airflow
Step Functions
MQTT

Location

Locations: Tallassee, Alabama or Duluth, Georgia. This is an onsite role in Duluth, GA, with travel to manufacturing or customer locations up to 20% as needed.

View full job page →

Today

Data Engineer - Telemetry & Analytics Pipeline

Entarian Denver, CO

Denver, CO

Today

$105k - $130k/yr Full time Amazon Web Services Analytics Arm/bicep

Apply Now

Job Description

Entarian is seeking a Data Engineer to design, build, and sustain telemetry and analytics pipelines that capture data from cloud, endpoint, network, and application sources. The role supports real-time processing and decision making for analytics, monitoring, and security, aligning with Zero Trust architectures and secure data practices. This on-site position in Denver collaborates across analytics, cloud, security, and platform engineering teams to ensure high-quality data flows that empower operational insights.

Note: Position is contingent upon contract award and funding.

Responsibilities

Design and implement scalable telemetry ingestion pipelines across cloud, endpoint, network, and application sources.
Build real-time and batch processing workflows using modern data engineering tools and technologies.
Develop data models, schemas, and metadata structures to support analytics, dashboards, and machine learning.
Optimize pipeline performance, reliability, observability, and data quality.
Integrate telemetry from identity systems, logging platforms, monitoring tools, and security technologies.
Create automation for ETL/ELT processes, data normalization, and event enrichment.
Collaborate with analytics, cloud, security, and platform engineering teams to define data requirements.
Ensure pipeline governance, compliance, retention, and secure data handling.
Troubleshoot ingestion issues, latency problems, schema drift, and data integrity concerns.
Document pipeline architecture, data flow diagrams, and operational procedures.

Requirements

Active Secret security clearance
Bachelor’s degree in information technology, computer science, engineering, or related technical discipline. (Equivalent experience may be considered.)
Minimum five (5) years of experience with a combination of modern data engineering platforms (Azure Data Factory, AWS Glue, Databricks, Kafka, Spark, Flink, etc.).
Strong skills in building data ingestion and streaming pipelines.
Proficiency in Python, SQL, or similar languages.
Knowledge of data modeling, ETL/ELT patterns, and distributed systems.
Familiarity with telemetry sources (logs, metrics, events) and common security/monitoring tools.
Experience with cloud storage systems (S3, ADLS, GCS) and data warehouses/lakehouses.
Understanding of data governance, lineage, and quality frameworks.
Good technical communication skills.
Proficiency with Microsoft Office Suite, including Word, PowerPoint, Excel, Project, and Outlook.
Ability to travel approximately 25% to support customer locations, mission partner engagements, and operational activities.

Technologies

Azure Data Factory, AWS Glue, Databricks, Kafka, Spark, Flink, Python, SQL, S3, ADLS, GCS, Elastic, Splunk, Azure Monitor, Grafana, OpenTelemetry, Terraform, ARM/Bicep

Location

Denver, CO (onsite)

Salary

USD 105,000 - 130,000 per year

View full job page →

Today

Operations Data Visualization and Analytics Engineer IV

CareSource Dayton, OH 🇺🇸 Remote

Dayton, OH

Today

$94k - $165k/yr Full time Analytics Business Analytics Business Intelligence

Apply Now

Job Description

CareSource offers a senior data role designed for impact, with remote flexibility and a clear path to influencing leadership decisions through scalable data architectures and insightful dashboards. This Operations Data Visualization and Analytics Engineer IV focuses on building robust database and ETL solutions, crafting Power BI dashboards, and turning complex data into actionable insights that guide cross functional initiatives. The position carries a competitive annual salary range of $94,100 to $164,800, plus a bonus tied to company and individual performance and a comprehensive total rewards package. It supports remote work from within the United States, with the option to base in Dayton, Ohio.

Responsibilities

Design scalable, department-wide database solutions that support reporting capabilities.
Build ETL pipelines for automated data refreshes and regular report delivery.
Create and deploy Power BI dashboards that surface actionable insights for executive decision-making.
Translate datasets and both quantitative and qualitative analyses into clear, decision-ready information for leaders.
Develop advanced analytic tools leveraging the data pipeline to track performance metrics, trends, and benchmarks.
Identify and implement internal process improvements, automate manual tasks, and optimize data delivery.
Conduct sophisticated analyses to deliver insights addressing strategic business questions.
Present analyses in executive-ready formats that are clear, engaging, and impactful.
Develop strategic plans for complex solutions involving multiple stakeholders.
Gather and analyze data, define business requirements, propose technology needs, review specs, and test systems.
Document, test, and validate solutions as needed.
Examine data relationships through testing to answer business questions identified by the department.
Mentor and guide junior team members on key projects.
Establish and enforce coding standards across the team.
Lead and contribute to large-scale data transformation and visualization projects that require cross-functional coordination.
Address multi-dimensional problems by producing reports, dashboards, and presentations.

Requirements

Bachelor's degree in Computer Science, Management Information Systems, or a related field, or foreign degree equivalent.
Seven years of progressively responsible experience with ETL, BI, and database solutions to translate business requirements.
At least three years of this experience in the health plan or healthcare industry.

Technologies

Power BI

Benefits

Bonus tied to company and individual performance.
Total rewards package.

Location and Travel

Based in Dayton, Ohio with remote work flexibility. Candidates may work remotely from anywhere in the United States.

Compensation

Compensation: $94,100.00 to $164,800.00 per year. Compensation type: Salary.

Organizational Competencies

Fostering a Collaborative Workplace Culture
Cultivate Partnerships
Develop Self and Others
Drive Execution
Influence Others
Pursue Personal Excellence
Understand the Business

View full job page →

Today

Analytics Engineer, Employee Technology Support

Bloomberg New York, NY

New York, NY

Today

$110k - $130k/yr Full time Analytics Business Analytics Business Intelligence

Apply Now

Job Description

Bloomberg's Employee Technology Support (ETS) team is expanding its analytics capabilities with an Analytics Engineer who will turn operational data into decision-ready insights. This onsite role in New York focuses on designing data models, building ETL pipelines, and delivering dashboards that enhance support operations. You will own data solutions end-to-end and collaborate with Engineering, Product, and business stakeholders to drive measurable improvements in service delivery and employee experience. The position offers a salary range of USD 110,000 - 130,000 per year.

Responsibilities

Partner with Employee Technology Support teams to understand operational challenges and design scalable data solutions.
Build and maintain robust data models, ETL pipelines, and automated data flows using SQL, Python, and Qlik Sense.
Develop dashboards, KPIs, and operational metrics that measure service performance, workload, employee experience, and operational efficiency.
Architect and optimize the data layer powering operational reporting, ensuring it is performant, well-documented, and reusable.
Perform data profiling, trend analysis, and root cause investigation to identify opportunities for process improvement.
Design and implement automated data validation and monitoring to improve data quality, consistency, and reliability.
Modernize legacy reporting and analytical workflows through automation and scalable solution design.
Translate business requirements into intuitive visualizations and actionable insights for technical and non-technical stakeholders.
Collaborate with Engineering and Product teams to improve data architecture, reporting capabilities, and system scalability.
Establish best practices around data modeling, pipeline design, reporting standards, and analytics development.
Communicate project progress, findings, and recommendations to stakeholders and senior leadership.
Own data solutions throughout their lifecycle, ensuring they remain accurate, reliable, and aligned with evolving business needs.

Requirements

Bachelor's degree or higher in Computer Science, Mathematics, Statistics, Information Systems, Data Analytics, or a related STEM discipline.
3+ years of experience building data engineering, business intelligence, or analytics solutions.
Advanced SQL skills and experience working with large relational datasets.
Strong Python development experience for data engineering, automation, and ETL workflows.
Experience building scalable data models, pipelines, reporting solutions, and dashboard applications.
Experience with Qlik Sense, Tableau, Power BI, or similar visualization platforms.
Strong understanding of data quality, validation techniques, and operational reporting.
Experience performing root cause analysis and translating findings into business recommendations.
Ability to manage multiple projects, independently prioritize work, and deliver high-quality solutions.
Excellent communication skills, with the ability to explain complex technical concepts to business stakeholders.

Technologies

SQL
Python
Qlik Sense
Tableau
Power BI

Benefits

Merit increases
Incentive compensation (exempt roles only)
Paid holidays
Paid time off
Medical
Dental
Vision
Short and long term disability benefits
401(k) + match
Life insurance
Wellness programs

View full job page →

Today

Lead Data Engineer / Data Architect

Glint Tech Solutions LLC Charlotte, NC

Charlotte, NC

Today

Full time Azure Data Factory Azure Data Lake Storage Azure Synapse Analytics

Apply Now

Job Description

This on-site opportunity in Charlotte, NC focuses on shaping enterprise data strategy and modernizing platforms across architecture modernization, migrations, and cloud-native microservices.

Responsibilities

Design and own enterprise data architecture to support high-volume retail eCommerce operations.
Develop and maintain ETL and ELT pipelines using Azure Data Factory, Synapse Analytics, and Databricks with PySpark.
Model conceptual, logical, and physical data structures for efficient storage and retrieval.
Implement data warehousing approaches such as dimensional modeling, star schemas, Data Mesh, Delta Lakehouse, and Data Vault.
Lead database migrations and microservices migrations toward unified, cloud-native solutions.
Integrate data from databases, APIs, and external providers via API integrations and message queues.
Embed metadata management and governance within cloud-based data platforms.
Guide and mentor cross-functional engineering teams, shaping technical strategy and stakeholder communications.

Requirements

8+ years of overall experience with at least 1 year in an Architect-level role.
3+ years of hands-on Azure Data Factory and Azure Synapse Analytics experience.
Deep Microsoft Azure expertise including Data Lake Storage, Databricks, PySpark, Cosmos DB, and PostgreSQL.
Strong SQL proficiency for complex queries, transformations, and cloud performance tuning.
Experience with Azure MI, Cosmos DB, Analysis Services, and Informix.
Proficiency in Python and Python-based ETL tools.
Shell scripting experience — Bash, Unix, or Windows.
Proven ability to lead teams, define technical strategy, and communicate across organizational levels.

Technologies

Azure Data Factory
Azure Synapse Analytics
Databricks
PySpark
Data Lake Storage
Cosmos DB
PostgreSQL
SQL
Python
Bash
Unix
Windows
Azure MI
Analysis Services
Informix
Elasticsearch
Docker
Kubernetes
Delta Lake
Delta Lakehouse
Data Mesh
Data Vault

Nice-to-have skills

Elasticsearch experience
Docker and Kubernetes familiarity
Performance tuning and pipeline optimization expertise
Azure, Databricks, or relevant cloud certifications

Company overview

Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States and Canada.

View full job page →

Today

Staff Data Engineer

Okta Chicago, IL

Chicago, IL

Today

$174k - $239k/yr Full time Senior Apache Airflow Cloud

Apply Now

Job Description

Benefits and Culture

Well being and health support for employees, prioritizing balance and flexibility
Meaningful opportunities to drive social impact through technical work
Focus on developing talent and building strong, connected teams across the organization

Location: Chicago, IL, hybrid work arrangement. Compensation: USD 174,000 - 238,700 per year.

Responsibilities

Spearhead the architectural evolution of the data platform, defining the roadmap for its future state
Shape and guide a technical strategy for large scale platform improvements, balancing long term goals with incremental delivery
Collaborate with engineers and leaders across data, platform, and security teams to forge a unified, secure architecture
Produce architectural artifacts such as design documents, threat models, and technical specifications to align stakeholders on complex initiatives
Serve as a technical mentor to the Data Engineering team, elevating performance through guidance, code reviews, and sharing best practices
Build foundational components of the new architecture by hands-on coding to model patterns others can follow

Requirements

Commitment to building secure, reliable, and scalable data systems
8+ years in software development, with at least 5+ years in data engineering or data platform roles
Proven track record delivering large-scale, cross-functional technical programs
Extensive experience designing and deploying data infrastructure in a cloud environment, with AWS strongly preferred
In-depth knowledge of the modern data stack including Snowflake, dbt, and Airflow
Strong proficiency in Python and SQL, with emphasis on code quality and system design
Excellent communication skills enabling clarity and informed decisions on complex technical topics
Ability to navigate ambiguity, chart a path forward, and lead others to successful outcomes

Technologies

Snowflake
dbt
Airflow
Python
SQL
AWS
Terraform
Kubernetes

About the Auth0 Data Engineering Team

Pipeline team focuses on efficient data ingestion and rapid access to unmodeled data, operating near the Platform team and data producers
Warehouse team models data in the data warehouse to simplify analysis for data consumers, supporting business teams and decision-making
Interface team builds and manages connections between the data platform and external systems, ensuring consistent, reliable data access