EngineerJobs.io
← Back to all jobs
Dahl Consulting

Data Engineer

Dahl Consulting
Brooklyn Park, MN $48 - $75/hr Contract Posted 26d ago
Big Data Bigdata Cloud Cloud Infrastructure Cloud Native Cloud Platform Cloud Platforms Cloud Technology Data Data Analysis Data Analytics Data Architecture Data Engineer Data Integration Data Lake Data Lakehouse Data Pipeline Data Pipelines Data Platform Data Processing Data Warehouse Database Databases Dataproc DevOps DevSecOps ETL Google Cloud Google Cloud Bigquery Informatica Information Technology (IT) Kafka Programming Language Programming Languages Spark SQL Stream Processing Streaming Data
Apply Now

Job Description

Dahl Consulting is seeking a Data Engineer to support large-scale data modernization and analytics efforts for retail and consumer services. This contract role is hybrid in Brooklyn Park, MN, focused on building scalable data platforms, high-performance pipelines, and dependable batch and streaming solutions primarily on Google Cloud Platform (GCP). If you enjoy production engineering with a focus on performance, reliability, and cost efficiency, this position aligns with your skill set.

What you will do

  • Design, develop, test, and maintain scalable data pipelines and ETL/ELT workflows for high-volume datasets.
  • Build and optimize distributed processing solutions using Apache Spark and GCP Dataproc.
  • Develop and maintain analytical datasets and processing workloads in BigQuery.
  • Create reliable batch and streaming data solutions using technologies such as Spark, Hadoop, and Kafka.
  • Support ingestion and transformation pipelines across source systems, data lakes, and analytics platforms.
  • Optimize Spark and BigQuery workloads for performance, scalability, reliability, and cost efficiency.
  • Troubleshoot production issues through root-cause analysis and implement long-term fixes.
  • Implement data quality controls, monitoring, logging, alerting, and operational processes.
  • Apply software engineering and DevOps best practices, including source control, CI/CD, automated testing, and deployment automation.
  • Collaborate with cross-functional teams to translate business needs into scalable data solutions.
  • Participate in code reviews and contribute to reusable frameworks, standards, and engineering practices.

What you bring

  • Proven experience in Data Engineering, including building and supporting production-grade data pipelines.
  • Hands-on experience designing and developing ETL/ELT solutions.
  • Experience working with Google Cloud Platform (GCP).
  • Strong expertise with BigQuery, including SQL development, performance tuning, and query optimization.
  • Hands-on experience with Apache Spark and distributed data processing frameworks.
  • Experience with GCP Dataproc.
  • Knowledge of Hadoop, Hive, Kafka, and the Apache Spark ecosystem.
  • Strong SQL skills for processing and analyzing large datasets.
  • Proficiency in Python and/or Java/Scala.
  • Understanding of data modeling, partitioning strategies, distributed computing concepts, and common data storage formats.
  • Experience with DevOps practices, including Git, CI/CD, automated deployments, and production support.
  • Strong analytical, troubleshooting, and problem-solving skills.

Tools and technologies

Google Cloud Platform (GCP), Google Cloud Dataproc, BigQuery, Apache Spark, Apache Hadoop, Kafka, Apache Hive, SQL, Python, Java, Scala, Git, CI/CD, Hadoop ecosystem tools, GCS, BigLake, Apache Iceberg, Parquet, Terraform, Looker, LookML, and Infrastructure as Code (IaC).

Additional qualifications (preferred)

  • Experience with Looker and/or LookML.
  • Experience with Google Cloud Storage (GCS), BigLake, Hive, Apache Iceberg, and Parquet.
  • Experience with Infrastructure as Code tools such as Terraform.
  • Experience building and supporting Kafka-based streaming pipelines.
  • Experience migrating data platforms or workloads from on-premises Hadoop/Hive environments to GCP.
  • Experience supporting large-scale data lake, cloud migration, or data platform modernization initiatives.
  • Familiarity with data governance, data quality, lineage, metadata management, and related best practices.

Compensation and benefits

Compensation: USD 48–75 per hour.

Benefits: Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/.

How to apply

Click the apply button to complete the mobile-friendly online application. After reviewing your details, a recruiter will reach out with next steps.

Similar Jobs