Data Engineer II, AWS Analytics Engineering
3d Design Tools
Amazon Quicksight
Amazon Web Services
Artificial Intelligence
AWS
Aws Data Engineer
Aws Data Engineering
Aws Data Services
Aws Data Warehouse
Aws Glue
Business Intelligence
Cloud
Cloud Data Engineering
Cloud Data Warehouse
Cloud Data Warehouse
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Processing
Data Visualization
Data Warehouse
Database
EMR
ETL
Reporting and Analytics
SQL
Job Description
Own analytics engineering for the EC2 + EBS + Networking Product BI team within AWS, delivering executive reporting, metrics, callouts, and dashboards using scalable AWS data pipelines.
Responsibilities
- Maintain end-to-end reliability and delivery timeliness for 200+ data pipelines that power executive-facing reports.
- Extend and operate automated alarms for real-time monitoring, including AI-powered agents that self-heal pipeline failures and triage tasks.
- Own WBR/DBR reporting for EC2 services, ensuring accurate and timely delivery to CEO/S-Team and VP-level stakeholders.
- Operate and improve report generation, validation, and delivery workflows, including workflows automated via LLMs.
- Generate executive callouts by identifying week-over-week trends, anomalies, and key drivers for 9 services.
- Own callout quality by continuously improving prompt and pipeline accuracy for LLM-automated callout generation across all 9 services.
- Ingest new data sources and build business health metrics (usage, capacity, adoption, customer growth).
- Ensure metrics are sustainable, reproducible, and available on demand using scalable ETL pipelines in Redshift with workflow orchestration.
- Conduct deep-dive analysis for Product Managers, Sales, and Finance; author and maintain governed SOPs and analyses in a proprietary analytics platform with stored context and pre-built queries.
- Design, build, and maintain interactive dashboards in QuickSight and Weave for product trends, customer growth, instance utilization, and feature adoption.
- Serve as the primary analytics point of contact for assigned service areas, translating business questions into data products and presenting findings to senior leaders.
- Partner with Product Managers and service finance teams to translate stakeholder needs into analytics deliverables.
Requirements
- 3+ years of data engineering experience.
- 3+ years developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes.
- 3+ years developing and operating large-scale data structures for business intelligence analytics using OLAP technologies.
- 3+ years developing and operating large-scale data structures for business intelligence analytics using data modeling.
- 3+ years developing and operating large-scale data structures for business intelligence analytics using SQL.
- 3+ years developing and operating large-scale data structures for business intelligence analytics using Oracle.
- 3+ years in the job offered or a related occupation experience.
- 1+ years developing and operating large-scale data structures for business intelligence analytics using ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
- Bachelor’s degree or foreign equivalent in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
- Experience with data modeling, warehousing, and building ETL pipelines.
Technologies
- Redshift
- Orchestration frameworks
- AWS data services
- ETL
- ELT
- OLAP
- SQL
- Oracle
- QuickSight
- Weave
- AWS Glue
- EMR
- Kinesis
- FireHose
- Lambda
- IAM roles and permissions
- S3
Benefits
- Health insurance (medical, dental, vision, prescription; Basic Life & AD&D insurance; option for Supplemental life plans; EAP; Mental Health Support; Medical Advice Line; Flexible Spending Accounts; Adoption and Surrogacy Reimbursement coverage)
- 401(k) matching
- Paid time off
- Parental leave
- sign-on payments and restricted stock units (RSUs)
Preferred Qualifications
- Experience with AWS technologies such as Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
- Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family databases).
About the Team
- The role supports the EC2 + Networking Product BI team within AWS Analytics & Engineering (AAE).
- Team provides data and analytics support for Amazon Elastic Compute Cloud (EC2), Networking Services, and adjacent Compute product families, serving 100+ Product Managers across 11 engagement areas.
- ETL Pipeline Monitoring & Operations: build and operate 200+ data pipelines ingesting, transforming, and serving petabyte-scale datasets across EC2, Networking, and Compute; automated alarms and AI-powered agents for self-healing and triage.
- Report Delivery & Callout Generation: deliver Weekly and Daily Business Review (WBR/DBR) reports across 9 Compute services (EC2 Core, Gen AI, EBS, Bedrock, SageMaker, ECS, EKS, ECR, Lambda) and generate callouts informed by executive decision-making, with report generation, validation, and callout generation using LLMs.
- Data Ingestion & Metric Creation: design and maintain metrics tracking business health (usage, capacity, adoption, customer growth) with sustainable, reproducible, on-demand availability.
- Analysis & Deep Dives: produce analyses for Product Managers, Sales, and Finance using a proprietary analytics platform with governed SOPs, context, and prior work.