Senior Data Engineer - AWS Data Platform (Redshift, Glue, and Airflow)
Backend Developer
Senior
3d Design Tools
Amazon Web Services
Apache Airflow
AWS
Aws Glue
Azure Data Factory
Cloud
Cloud Computing
Cloud Data Warehouse
Cloud Native
Cloud Operations
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Factory Azure
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Google Cloud
Informatica
IT Services
Microsoft Azure
Redshift
Rendering Engines
Reporting and Analytics
Software Engineering
SQL
Job Description
Design and deliver analytics-focused data solutions across warehouse, pipelines, and operations in a fully remote environment.
Responsibilities
- Design database architecture and build data warehouses and data marts to support presentation-layer elastic cubes, reporting, and analytics
- Develop and tune SQL using T-SQL or PL/pgSQL, including table development, stored procedures, and functions
- Create indexes to improve performance for production workloads
- Build and maintain ETL/ELT processes, including shared responsibility for monitoring data warehouses and data marts
- Develop and support data pipelines using Airflow, AWS Glue, Azure Data Factory, Python, and Golang
- Troubleshoot and resolve data issues in production systems
- Collaborate with business users and project managers to address business problems and implement solutions
- Apply technical experience to recommend improvements for existing and new problems
- Coordinate with other IT departments, including systems communication processes
- Participate in meetings with IT groups (other departments and computer operations staff) to address issues and concerns across business unit IT and technical operations groups
- Mentor other Data Engineers
- Identify software solutions needed for new project work
- Provide weekly reporting to management on project status and issues
- Support production with on-call duties
Requirements
- 7+ years data warehousing / OLAP experience
- 7+ years multidimensional database architecture and design experience
- 5+ years SQL experience
- 3+ years Python experience
- 2+ years Redshift experience
- 2+ years NoSQL experience
- Team and vendor partner management experience
- Clear understanding of principles and techniques of Web development
- Experience with AWS Glue and Airflow
- Experience with API
- Dimensional database architecture experience
- Formal systems life cycle methodology experience
Technologies
- tsql, psql
- Airflow, AWS Glue
- Azure Data factory
- Python, Golang
- Azure, AWS, GCP
- Redshift
Desired Qualifications
- Cloud Data Warehouse operations experience
- Tableau, SSRS, big data, and Realtime BI experience
- Experience with data streaming
Location
- Orlando, FL (remote)
- Fully remote: contribute from a non-Versant worksite, most commonly an employee’s residence