Data Engineer - Project Delivery Senior Analyst
Job Description
In Deloitte's Project Delivery group, this Senior Data Engineer role centers on designing scalable data pipelines for a broad delivery program. The position emphasizes building and operating data flows on AWS and Snowflake, delivering curated datasets and analytics-ready assets. The role is based onsite in Cincinnati, Ohio, with limited travel.
Responsibilities
- Design, build, and operate scalable batch and near real time data pipelines on AWS, ensuring reliability and performance.
- Architect robust ingestion patterns from source systems into S3 and Snowflake.
- Create transformation layers and curated datasets in Snowflake, including dimensional models for analytics and downstream applications.
- Implement orchestration and workflow automation on AWS with retry logic, backfills, and idempotent processing.
- Support Snowflake performance and cost optimization through warehouse sizing, concurrency patterns, query tuning, clustering/micro-partitioning, and workload isolation.
- Collaborate with stakeholders to translate requirements into well defined datasets and data contracts.
- Maintain regular communication with Engagement Managers, project teams, and cross functional technical partners, escalating issues as needed for engagement management.
- Lead client engagement workstreams, independently or with teams, focused on process improvement, optimization, and transformation, implementing leading practice workflows and driving operational outcomes.
Requirements
- 4+ years of experience delivering production grade data pipelines and curated datasets as a Data Engineer.
- 4+ years of hands-on SQL and Python experience, including Snowflake and/or PySpark for scalable data processing and ELT.
- 4+ years designing, building, and supporting batch and near real time data pipelines on cloud platforms, with AWS preferred (Azure/GCP acceptable).
- Experience with data integration frameworks and orchestration tools.
- Working knowledge of Lakehouse/warehouse architectures and ELT patterns.
- Knowledge of DevOps principles, including CI/CD pipelines, version control, and Infrastructure as Code.
- Ability to optimize data storage, partitioning, file formats (Delta, Parquet), and overall performance.
- Understanding of data quality, data governance, and metadata management.
- Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or a related IT discipline, or equivalent experience.
- Limited immigration sponsorship may be available.
- Ability to travel up to 10% on average, depending on client engagements.
Technologies
- AWS, Snowflake, S3, Python, SQL, PySpark, Delta, Parquet
Benefits
- Eligible to participate in a discretionary annual incentive program
Preferred
- Agile delivery experience
- Analytical ability to manage multiple projects and prioritize tasks into manageable work products
- Ability to operate independently or with minimal supervision
- Excellent written and verbal communication skills
- Ability to deliver technical demonstrations