EngineerJobs.io
← Back to all jobs
Experis

Big Data Engineer (No C2C)

Experis
McLean, VA $72 - $75/hr Full time Posted 9d ago
Big Data Bigdata Data Data Analysis Data Analytics Data Engineer Data Integration Data Pipeline Data Platform Data Processing Data Warehouse Database Databases ETL Hadoop Hive Informatica Information Technology (IT) Scala Software Development Software Engineering SQL
Apply Now

Job Description

The Big Data Engineer will join the Data Engineering team to support analytics and data platform initiatives. This onsite role focuses on building and enhancing reliable, scalable data pipelines and partnering with cross-functional stakeholders to enable data-driven decision-making.

Role Overview

In this position, you will design large-scale processing pipelines, improve data pipeline performance and reliability, and help ensure data quality through automated testing. You will work closely with data scientists and analysts to support enterprise analytics needs.

Key Responsibilities

  • Design, develop, and maintain large-scale data processing pipelines using Big Data technologies such as Hadoop, Spark, Python, and Scala.
  • Implement data ingestion, storage, transformation, and analysis solutions that are scalable, efficient, and reliable.
  • Optimize and enhance existing data pipelines for performance, scalability, and reliability, including troubleshooting production issues.
  • Develop automated testing frameworks and implement continuous testing to support data quality assurance.
  • Collaborate with cross-functional teams, including data scientists and analysts, to support data-driven decision-making.

Required Qualifications

  • Bachelor’s degree in Computer Science, Information Systems, or a related discipline, with at least five (5) years of related experience, or equivalent training and/or work experience.
  • Demonstrated expertise in object-oriented and database technologies and concepts, with experience delivering enterprise-quality solutions.
  • Strong software engineering background in test automation, build automation, and configuration management, with experience in iterative or Agile delivery.
  • Hands-on experience with Hadoop, Spark, Hive, and Trino, including debugging and mitigation for issues such as data skew and resource-related job failures.
  • Strong SQL skills, including window functions, joins, and complex queries, with the ability to write and optimize SQL queries while handling edge cases such as NULLs, duplicates, and ordering.

Core Technologies

  • Hadoop
  • Spark
  • Python
  • Scala
  • Hive
  • Trino
  • SQL

Location and Pay

This role is located in McLean, VA and is onsite. The pay range is $72 to $75 per hour, depending on years of experience.

Benefits

Benefits listed below are available after the completion of the waiting period:

  • Medical and Prescription Drug Plans
  • Dental Plan
  • Vision Plan
  • Health Savings Account
  • Health Flexible Spending Account
  • Dependent Care Flexible Spending Account
  • Supplemental Life Insurance
  • Short Term and Long Term Disability Insurance
  • Business Travel Insurance
  • 401(k), Plus Match
  • Weekly Pay

Similar Jobs