Data Engineer II, Veritas, Security Tools Foundation
Job Description
Amazon Security (AmSec) is hiring a Data Engineer II to design and deliver high-quality datasets, data infrastructure, and CI/CD data pipelines that support security investigations and application modeling within Veritas. This onsite role is based in Seattle, WA.
Responsibilities
- Collaborate with partners to influence the team data strategy and define the data storage roadmap.
- Lead data governance strategy by defining data schemas and creating tools that enable efficient data sharing while following highly confidential data handling guidelines.
- Improve data quality and operations through automation and by building end-to-end CI/CD data pipelines.
- Apply best practices for data integrity, data modeling, testing, analysis, validation, and documentation.
- Build end-to-end pipelines to ingest and transform data from multiple data sources and systems.
- Use AI/LLM approaches to automate manual and redundant data engineering work.
- Evaluate and implement big-data technologies to optimize processing for extremely large datasets, including Redshift, Iceberg, Hive/EMR, Spark, SNS, and SQS.
- Understand and analyze business processes, logical data models, and relational database implementations.
- Write high-performing, optimized SQL queries.
Minimum Qualifications
- 3+ years of data engineering experience.
- 1+ year developing and operating large-scale data structures for business intelligence analytics using ETL/ELT.
- 1+ year developing and operating large-scale data structures for business intelligence analytics using OLAP technologies.
- 1+ year developing and operating large-scale data structures for business intelligence analytics using data modeling.
- 1+ year developing and operating large-scale data structures for business intelligence analytics using SQL.
- 1+ year developing and operating large-scale data structures for business intelligence analytics using Oracle.
- 3+ years in the job offered or related occupation experience.
- 1+ year developing and operating large-scale data structures for business intelligence analytics using ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform).
- Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
- Experience with data modeling, warehousing, and building ETL pipelines.
Preferred Qualifications
- Experience with AWS services such as Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
- Experience with non-relational databases and data stores, including object storage, document or key-value stores, graph databases, and column-family databases.
Technologies
- AWS services: EMR, Glue, Athena, Redshift, S3, SNS, SQS, Kinesis, FireHose, Lambda
- Apache Airflow
- ETL, ELT, OLAP
- Oracle, Iceberg, Hive/EMR, Spark
- IAM roles and permissions
- Non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- SQL
Compensation
USD 132,100 - 178,800 per year.
Benefits
- Sign-on payments
- Restricted stock units (RSUs)
- Health insurance (medical, dental, vision, prescription)
- Basic Life & AD&D insurance and option for Supplemental life plans
- EAP, Mental Health Support, Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
About the Team
At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. The team emphasizes an inclusive culture, training and career growth, diverse experiences, and work/life balance.