Senior Data Engineer
Senior
Apache Airflow
AWS
Big Data
Bigdata
Cloud
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
ETL
Informatica
Integration
Kafka
Matillion
Nifi
Programming Languages
Snowflake
Spark
SQL
SSIS
Stream Processing
Job Description
Senior Data Engineer based onsite in Tampa, FL, responsible for designing, deploying, and maintaining data ingestion, transformation, and maintenance pipelines to support enterprise data needs across cloud and on‑prem environments, with a focus on automation and self‑service improvements.
Responsibilities
- Develop Snowflake–driven data architectures aligned with business needs and industry best practices
- Perform data analysis, create data models, reverse engineer schemas as needed, and optimize performance
- Collaborate with fellow data engineers to design and optimize ELT/ETL pipelines using Matillion and Snowflake native features
- Build, deploy, and enhance data pipelines to create or improve data warehouses and data marts
- Provision infrastructure for efficient extraction, transformation, and loading from diverse sources using AWS and database technologies
- Stay up to date with AI technologies and best practices, focusing on Snowflake AI capabilities to improve AI‑driven data solutions
- Document technical specifications, data models, process flows, standards, and procedures
- Identify and implement internal process improvements, redesigning infrastructure for scalability and automating manual processes
- Mentor data engineering team members on advanced concepts and principles
- Define comprehensive data processing strategies to achieve optimal outcomes
- Provide on‑call production support on a rotating basis, monitoring and resolving data engineering service issues
- Establish design, test, documentation, and implementation standards in accordance with HIPPA and other patient data management policies and ensure compliance
Requirements
- Bachelor’s degree in Information Systems, Computer Science, Business Administration, or a related field
- Minimum eight years of experience implementing data engineering initiatives
- Minimum three years of cloud experience, AWS preferred
- Minimum three years of experience working with cross‑functional teams, gathering requirements, architecting data models, and developing shared datasets
Technologies
- Snowflake
- Matillion
- AWS
- Apache NiFi
- Informatica
- SSIS
- Spark
- Kafka
- Airflow
- Git
- Subversion
- Jenkins
- Maven
- Python
- T‑SQL
- SQL
- NoSQL
- Lambda
- EC2
- S3
- RDS