Senior Data Engineer
Senior
Amazon Emr
Amazon Web Services
AWS
Aws Glue
Big Data
Bigdata
Cloud
Cloud Operations
Cloud Platforms
Data Analysis
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
EMR
ETL
Hadoop
Hive
Lambda
Node Js
Scala
Software Engineering
SQL
Job Description
Amazon Development Center U.S., Inc. offers a competitive compensation package and a culture that emphasizes collaboration, mentorship, and technical ownership. This on-site opportunity in Seattle, WA provides a salary range of USD 154,600 to 209,100 per year, comprehensive health coverage, and opportunities to influence data architecture at scale. As a Senior Data Engineer, you will own 3-5 data domains end-to-end, operate hundreds of pipelines, and drive architectural improvements that impact AWS leadership decisions. You will partner with service teams across AWS to design data contracts, ingestion flows, and analytical models at AWS scale.
Responsibilities
- Identify limitations and opportunities in data processing tools, drive improvements, define data processing guidelines, and ensure best practices across pipelines. Examples include redesigning ingestion frameworks to handle new AWS service telemetry data or creating reusable transformation patterns adopted across teams.
- Define and own data architecture at the team level, ensuring solutions align with business problems and data challenges while addressing security, scalability, and cost considerations. Exercise sound judgment when balancing short-term technology needs with long-term business goals.
- Produce exemplary code that is usable by customers, secure, maintainable, scalable, and extensible. Build solutions that are easy for others to contribute to and work to simplify, optimize, and remove bottlenecks.
- Define and own infrastructure architecture at the team level. Anticipate data management and access patterns, evolve the technology stack to remove bottlenecks, and deliver systems that are secure, scalable, and long lasting. Establish team guidelines and best practices for infrastructure management and automation.
- Solve complex ambiguous problems, such as designing cross-domain data models that unify billing, usage, and service telemetry data, or combining multiple datasets to solve problems that were previously unsolvable. Identify areas that might lead to data misinterpretation or gaps in data contracts.
- Effectively split project work into parallel tasks that can be performed independently and reassembled successfully. Drive projects to completion with dependencies on peers or other teams.
- Influence related teams' data architecture and software design. Provide technical assessments for promotions. Actively mentor and develop others. Build consensus when faced with differing views.
- Drive data engineering best practices β Data Discovery, Naming Conventions, Operational Excellence, Data Security. Ensure the team's data is auditable, available, and accessible.
- Proactively fix data architecture deficiencies and propose larger projects that may require collaboration with other teams. Promote improvements through code reviews, design discussions, team planning, and operational reviews.
- Participate in on-call rotation and own the operational health of data systems β establish monitoring, alarming, runbooks, and SLA tracking. Drive continuous improvement in reliability and incident response.
Requirements
- 7+ years of data engineering experience
- Experience with data modeling, warehousing, and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices
- Experience with MPP databases such as Amazon Redshift
- Experience building and operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
Technologies
- AWS EMR
- AWS Glue
- Amazon Redshift
- AWS Lambda
- Large Language Models (LLMs)
- Hadoop
- Hive
- Spark
- Python
- Java
- Scala
- NodeJS
- SQL
Benefits
- Sign-on payments
- Restricted stock units (RSUs)
- Health insurance (medical, dental, vision, prescription)
- Basic Life & AD&D insurance and option for Supplemental life plans
- Employee Assistance Program (EAP)
- Mental Health Support
- Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave