Big Data Engineer II
Job Description
Architect scalable big data solutions for AWS revenue data products by building data pipelines and AI driven automation, while mentoring engineers and translating business needs into technical solutions.
Responsibilities
- Advance the Revenue technology stack to scale with AWS growth, ensuring compliance with security policies, architectural standards, and operational best practices
- Design and implement end to end data pipelines that convert raw data from diverse upstream sources into actionable insights for quota management, forecasting, and compensation decisions
- Create frameworks, tools, and AI powered solutions that automate manual processes, reduce operational overhead, and accelerate time to insight for Revenue customers
- Build and maintain dimensional data models and structures that enable self service analytics and support evolving reporting needs across Finance, Sales Operations, and Analytics
- Mentor a team of data engineers to deliver cross functional solutions, foster technical growth, and uphold engineering excellence standards
- Architect and optimize Revenue data infrastructure to ensure enterprise grade security, cost efficiency, and scalability while processing billions of daily transactions across 20 plus data sources
- Collaborate with product managers, stakeholders, and customers to translate business requirements into technical solutions
Requirements
- 3+ years of data engineering experience
- 3+ years of developing and operating large scale data structures for business intelligence analytics using ETL/ELT processes
- 3+ years of developing and operating large scale data structures for business intelligence analytics using SQL
- Bachelor's degree or above in Computer Science, Computer Engineering, Data Science, Electrical Engineering, or related fields, or 3+ years of professional software development experience
- Experience in at least one object oriented programming language (e.g., JavaScript, Python, C#)
Technologies
- JavaScript
- Python
- C#
- SQL
- Amazon Redshift
- AWS S3
- AWS Glue
- AWS EMR
- AWS Kinesis
- AWS Firehose
- AWS Lambda
- AWS IAM
- Hadoop
- Hive
- Spark
Benefits
- Health insurance
- 401(k) matching
- Paid time off
- Parental leave
- Sign on payments
- Restricted stock units (RSUs)