Apache Beam Engineer Jobs

1 job found

1d ago

Senior Data Engineer

Software Resources, Inc. Lake Buena Vista, FL

Lake Buena Vista, FL

1d ago

Contract Senior Analytics Apache Beam

Apply Now

Job Description

Contract Senior Data Engineer in Lake Buena Vista, FL, with a hybrid schedule on-site Monday through Thursday and remote Fridays, focusing on designing, developing, and implementing data engineering systems and ETL/ELT pipelines.

Responsibilities

Contribute to data requirements gathering with stakeholders
Perform source-to-target mapping activities
Develop and review data validation scripts
Design, implement, and monitor ETL and ELT pipelines
Produce datasets used as inputs for science models and visualizations
Participate in technical reviews to ensure quality deliverables
Develop domain understanding of business processes and apply it to assigned work
Communicate data engineering progress to the project leadership team
Actively participate in meetings and discussions

Requirements

Minimum 2 years of relevant professional experience
Bachelor’s degree in Computer Science, Mathematics, Software Engineering or related field, or equivalent experience
5+ years of ELT/ETL development experience using SQL and Python
2+ years developing and maintaining data pipelines with a framework such as Apache Flink, Apache Beam or Kafka Streams
Experience understanding a business domain to support data requirements and design solutions
Experience delivering code across multiple environments (Dev, QA, Prod) and applying DevOps practices for deployment and promotion
Strong database design skills and experience with PostgreSQL or Snowflake
Experience managing and deploying code using GitLab or GitHub
Ability to articulate solutions and explain complex technical concepts to non-technical teammates

Technologies

Snowflake
SQL
Python
Apache Flink
Apache Beam
Kafka Streams
Docker
Kubernetes
AWS
Databricks
PostgreSQL
GitLab
GitHub

Benefits

Medical, dental, and vision coverage
401(k) with company match
Short-term disability
Life insurance with AD&D

View full job page →

Get Apache Beam Engineer Jobs alerts

New Apache Beam Engineer Jobs, daily.