EngineerJobs.io
← Back to all jobs
EchoStar

Data Engineer II

EchoStar
Englewood, CO $83k - $119k/yr Full time Posted 5d ago
Big Data Bigdata Cloud Data Engineering Cloud Data Platform Cloud Platform Cloud Platforms Data Data Analysis Data Analytics Data Architecture Data Engineer Data Engineering Data Integration Data Lakehouse Data Pipeline Data Platform Data Processing Data Warehouse Database Databases Databricks ETL Informatica Information Technology (IT) Programming Programming Languages Spark SQL
Apply Now

Job Description

EchoStar is hiring a Data Engineer II to design and optimize production-grade batch and streaming data pipelines. The role focuses on AWS and Apache Spark development, with additional ownership of workflow orchestration proof-of-concepts and integrations that support automated data quality and documentation.

Role Summary

Build and optimize high-performance data pipelines for batch and streaming data processing using AWS and Spark. Lead proof-of-concept initiatives for workflow orchestration with Apache Airflow and integrate Amazon Q services to support automation across data quality, documentation, and governance.

Responsibilities

  • Design, construct, and optimize scalable data pipelines for batch and streaming processing from various internal and external sources
  • Develop and manage data processing jobs using Apache Spark on Amazon EMR clusters, focusing on performance, cost-efficiency, and scalability
  • Implement transformation logic and complex data workflows primarily using Python, PySpark, and SQL
  • Lead a proof-of-concept evaluating Apache Airflow as an enterprise-wide workflow orchestration tool, including the design and deployment of Directed Acyclic Graphs (DAGs) to manage dependencies
  • Explore and implement integration points for Amazon Q into data pipelines as part of the orchestration proof-of-concept, supporting automated data quality checks, data documentation generation, or pipeline optimization
  • Implement CI/CD pipelines for data platform components using GitLab, leveraging Infrastructure-as-Code templates while maintaining strict data governance, security, and quality across the lifecycle
  • Participate in at least one in-person interview

Required Qualifications

  • Education: Bachelor’s Degree in Computer Science, Data Engineering, or a related technical field
  • Experience: Minimum of 2 years of experience in Big Data and Data Engineering
  • At least 2 years of experience with Python and SQL
  • At least 2 years of experience with Amazon EMR and Apache Spark
  • At least 2 years of experience with Apache Airflow or Control M
  • At least 2 years of experience with GitLab CI/CD pipelines
  • At least 2 years of experience with Amazon Q or Generative AI tools
  • Preferred: Experience with Databricks

Technology Stack

  • Python, PySpark, SQL
  • Apache Spark, Amazon EMR
  • Amazon Q
  • Apache Airflow, Control M
  • Git, GitLab
  • Infrastructure-as-Code; Terraform, AWS CloudFormation
  • Amazon EC2, Amazon S3
  • Directed Acyclic Graphs (DAGs)
  • Databricks

Compensation

Salary range: USD 83,160 - 118,800 per year

Benefits

  • Flexible spending accounts
  • HSA
  • 401(k) Plan with company match
  • ESPP
  • Career opportunities
  • Flexible time away plan

Benefits can be viewed here: EchoStar Benefits.

Pre-Employment Screening

Candidates must successfully complete a pre-employment screen, which may include a drug test and DMV check.

Location and Posting Details

Location: Englewood, CO (onsite)

  • The posting will be active for a minimum of 3 days.
  • The active posting will extend by 3 days until the position is filled.

Similar Jobs