Lead Data Engineer
Job Description
The Lead Data Engineer role supports telecom-focused data engineering initiatives in Plano, TX. The position emphasizes scalable ETL and data processing pipelines using Python/PySpark and Databricks on AWS and Azure.
Role Overview
In this Lead Data Engineer assignment, you will design, develop, and maintain high-performance ETL pipelines and analytics-ready data workflows. The engagement is planned for 9 Months + Extension and is based in Plano, TX (onsite).
Responsibilities
- Design, develop, and maintain scalable, high-performance ETL pipelines and data processing workflows.
- Build and optimize data ingestion frameworks for large volumes of structured and unstructured data.
- Perform data preprocessing, transformation, and analytics using Python and PySpark.
- Develop and manage ETL processing pipelines using AWS/Azure Databricks.
- Build complex SQL queries and conduct data analysis to support business and reporting requirements.
- Design and implement data warehouse solutions for enterprise analytics and reporting.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
- Develop reliable, efficient, and reusable data processing frameworks that adapt to evolving business needs.
- Support data validation, quality checks, and performance tuning and optimization of ETL processes.
- Work in a fast-paced environment to deliver data engineering solutions aligned with business objectives.
- Create reports and visualizations using Tableau to enable data-driven decision-making.
Required Technologies
- Python
- PySpark
- AWS
- Azure Databricks
- SQL
- Tableau
Location, Duration, and Engagement Details
- Location: Plano, TX (onsite)
- Duration: 9 Months + Extension
- Domain exposure: Telecom
- Job ID: J56127
- Client: To Be Discussed Later
Employment Type and Compensation
- Employment type: W-2, 1099, C2C
- Bill rate: $73/hour (C2C)
- Salary range: USD 73 - 73 per hourly
Work Authorization
- US Citizen
- Green Card
- OPT-EAD
- CPT
- H-1B
- H4-EAD
- Other