The Data Engineer II role on the AWS AMPS team centers on designing, building, and optimizing data pipelines and infrastructure to enable analytics and machine learning across AWS Marketplace. The position requires close collaboration with software engineers, data scientists, and business intelligence professionals to empower data-driven decision making.
Responsibilities
- Architect and implement next generation data pipelines and BI solutions.
- Manage AWS resources including EC2, RDS, Redshift, Kinesis, EMR, and Lambda.
- Deliver high quality data architectures and pipelines to support business analysts, data scientists, and customer reporting needs.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources.
- Improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
- Collaborate with Software Engineers, Product Managers, Data Scientists, and BI Engineers to plan and deliver on high priority data initiatives for internal stakeholders and AWS customers.
- Build automated, fault tolerant, and scalable data solutions leveraging technologies such as Spark, EMR, Python, Redshift, Glue, and S3.
- Identify opportunities and apply creative approaches to data challenges.
- Continuously evaluate and improve strategy, architecture, tooling, and codebase to maximize performance, scalability, and availability.
Requirements
- 5+ years of data engineering experience.
- Experience with data modeling, warehousing, and building ETL pipelines.
- Proficiency in at least one modern programming language such as C++, C#, Java, Python, Golang, PowerShell, or Ruby.
- 3+ years analyzing and interpreting data with Redshift, Oracle, NoSQL, or equivalent technologies.
- 3+ years of experience with big data technologies including AWS services, Hadoop, Spark, Pig, Hive, Lucene/SOLR, Storm, or Samza.
Technologies
- EC2
- RDS
- Redshift
- Kinesis
- EMR
- Lambda
- Spark
- Python
- Glue
- S3
- Airflow
- CDK
- Hadoop
- Pig
- Hive
- Lucene/SOLR
- Storm
- Samza
Benefits
- Health insurance
- 401(k) matching
- Paid time off
- Parental leave
- Sign-on payments
- Restricted stock units (RSUs)
About the Team
We are the Data Engineering group within AMPS, powering analytics for the AWS Marketplace Platform. Our data supports external Marketplace sellers as well as more than 3,000 internal Finance, Sales, and Partner stakeholders. We are building a unified Canonical Data Model on Redshift and Data Lake, pursuing greenfield data engineering at scale by designing ETL frameworks, migrating billions of rows, and prioritizing data quality and security. Our work spans Redshift, Airflow, Glue, S3, and CDK.
Diversity Experiences
AWS values diverse experiences. Even if you do not meet every preferred qualification, we encourage you to apply. If your career path has been nontraditional or includes alternative experiences, consider sharing how these have prepared you for this role.
Why AWS?
Amazon Web Services is the world’s most comprehensive and widely adopted cloud platform. AWS pioneered cloud computing and continues to innovate, earning the trust of startups and Global 500 companies alike with a robust suite of products and services to power their businesses.
Inclusive Team Culture
AWS fosters curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower teams to bring diverse perspectives. Inclusion events strengthen collaboration and drive innovation through bold ideas and diverse voices.
Mentorship & Career Growth
We strive to raise our performance bar and support professional development through continuous knowledge sharing, mentorship, and resources aimed at developing well-rounded professionals.
Work/Life Balance
We value work-life harmony and offer flexibility as part of our working culture. A supportive environment at work and at home enables teams to achieve a high level of performance.
