Senior Data Engineer
Senior
Analytics
Apache Beam
Big Data
Cloud
Cloud Infrastructure
Cloud Native
Cloud Platform
Cloud Platforms
Cloud Technology
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
DevOps
Engineering
ETL
Flink
GitHub
Gitlab
Kafka Streams
Kubernetes
PostgreSQL
Programming Languages
Snowflake
Software Development
SQL
Job Description
Contract Senior Data Engineer in Lake Buena Vista, FL, with a hybrid schedule on-site Monday through Thursday and remote Fridays, focusing on designing, developing, and implementing data engineering systems and ETL/ELT pipelines.
Responsibilities
- Contribute to data requirements gathering with stakeholders
- Perform source-to-target mapping activities
- Develop and review data validation scripts
- Design, implement, and monitor ETL and ELT pipelines
- Produce datasets used as inputs for science models and visualizations
- Participate in technical reviews to ensure quality deliverables
- Develop domain understanding of business processes and apply it to assigned work
- Communicate data engineering progress to the project leadership team
- Actively participate in meetings and discussions
Requirements
- Minimum 2 years of relevant professional experience
- Bachelor’s degree in Computer Science, Mathematics, Software Engineering or related field, or equivalent experience
- 5+ years of ELT/ETL development experience using SQL and Python
- 2+ years developing and maintaining data pipelines with a framework such as Apache Flink, Apache Beam or Kafka Streams
- Experience understanding a business domain to support data requirements and design solutions
- Experience delivering code across multiple environments (Dev, QA, Prod) and applying DevOps practices for deployment and promotion
- Strong database design skills and experience with PostgreSQL or Snowflake
- Experience managing and deploying code using GitLab or GitHub
- Ability to articulate solutions and explain complex technical concepts to non-technical teammates
Technologies
- Snowflake
- SQL
- Python
- Apache Flink
- Apache Beam
- Kafka Streams
- Docker
- Kubernetes
- AWS
- Databricks
- PostgreSQL
- GitLab
- GitHub
Benefits
- Medical, dental, and vision coverage
- 401(k) with company match
- Short-term disability
- Life insurance with AD&D