Senior Data Engineer
Job Description
Senior Data Engineer contract role in New York, NY (remote) for a leading music streaming company.
Responsibilities
- Design, develop, and sustain scalable, high‑performance data pipelines, ETL workflows, and distributed data processing systems using Apache Spark and related frameworks.
- Build and optimize data models and cloud-based data warehouse infrastructure while ensuring data quality, reliability, and performance.
- Develop complex SQL queries and data integration solutions to support analytics, reporting, and business intelligence initiatives.
- Collaborate with cross‑functional teams to consolidate data from multiple sources, troubleshoot performance issues, and apply scalable data engineering best practices.
- Monitor, optimize, and maintain data platforms; research emerging technologies and contribute to continuous process improvements.
Requirements
- Minimum 5 years of data engineering experience.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Strong expertise with Python and Apache Spark.
- Solid understanding of distributed systems, data modeling, and ETL processes.
- Experience designing and maintaining scalable data pipelines.
- Experience with cloud-based data warehouses such as AWS Redshift, Snowflake, or Teradata.
- Advanced SQL skills.
- Scala experience is preferred.
- Databricks experience is preferred.
Technologies
- Apache Spark
- Python
- AWS Redshift
- Snowflake
- Teradata
- SQL
- Scala
- Databricks
Benefits
- Group Medical
- Dental
- Vision
- Life
- Retirement Savings Program
- PSL
Compensation
- Hourly rate: USD 60 - 70
Shift
- Monday to Friday, 9:00 am to 5:00 pm