Project - Data Engineer
Job Description
Deloitte seeks a Project Data Engineer in Stamford, CT (onsite) with a salary range of USD 57,300 to 95,500 per year to design and operate data pipelines and analytics-ready datasets in AWS and Snowflake for a large-scale program.
Responsibilities
- Design and evolve end-to-end data pipelines on AWS using Python to ingest, transform, and deliver data to Snowflake and downstream analytics users.
- Create and maintain Snowflake objects (schemas, tables, views) and implement performant SQL transformations to produce curated, analytics-ready datasets.
- Automate workflows and scheduling with tools such as MWAA Airflow, Step Functions, and Glue, including dependency management, retries, and centralized logging.
- Implement data quality checks and basic observability (validation rules, reconciliations, alerts) and assist with incident triage and remediation.
- Optimize pipeline and query performance with guidance on efficient Python code, S3 partitioning and file formats, and Snowflake warehouse usage and query tuning.
- Adhere to CI/CD and IaC standards (Git-based workflows, Terraform/CloudFormation) to promote code across environments.
- Collaborate with analysts, product owners, and source-system teams to clarify requirements and validate outputs; participate in sprint ceremonies and estimations.
- Contribute to code reviews, unit tests, and peer debugging; learn and apply team engineering standards.
- Maintain regular communication with Engagement Managers, project teams, and stakeholders, escalating matters as needed for engagement management.
- Lead client engagement workstreams focused on process improvement, optimization, and transformation, implementing leading practices and driving operational outcomes.
Requirements
- 1+ year of experience building and enhancing data pipelines and curated datasets for analytics consumers.
- 1+ year of hands-on SQL and Python experience, including Snowflake and/or PySpark for transformations and scalable processing.
- 1+ year of cloud data engineering experience on AWS (preferred) or Azure/GCP, with orchestration/scheduling (Airflow/MWAA, Step Functions, Glue, ADF/Fabric Data Factory).
- Understanding of ELT patterns and Lakehouse/warehouse concepts; familiarity with S3 file formats and partitioning (Parquet/Delta).
- Working knowledge of DevOps practices (Git-based workflows, CI/CD) and exposure to Infrastructure-as-Code (Terraform/CloudFormation).
- Understanding data quality, basic observability, and metadata/governance fundamentals.
- Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related IT field, or equivalent experience.
- Limited immigration sponsorship may be available.
- Ability to travel approximately 10% on average based on client assignments.
- Agile delivery experience.
- Analytical ability to manage multiple projects and prioritize tasks into actionable work products.
- Ability to operate independently or with minimal supervision.
- Excellent written and verbal communication skills.
- Ability to deliver technical demonstrations.
- Technologies frequently used: AWS, Python, Snowflake, SQL, PySpark, Airflow (MWAA), Step Functions, Glue, Terraform, CloudFormation, Git, Parquet, Delta, S3, Azure Data Factory, Fabric Data Factory.
Benefits
- Discretionary annual incentive program