AWS Data Engineer
Job Description
Wipro Limited is hiring an AWS Data Engineer for an onsite role in Torrance, California. In this position, you will design and build scalable AWS-based data pipelines and analytics-ready data platforms, with a focus on reliable data processing, security controls, and production support.
Role overview
You will develop ETL/ELT pipelines and cloud data lake or data warehouse solutions, including data transformation with Python, PySpark, and SQL. The role also covers data quality, monitoring, logging, exception handling, and optimization of AWS workloads for performance, scalability, reliability, and cloud cost. Support for CI/CD and ongoing troubleshooting for data pipelines is part of the day-to-day responsibilities.
Responsibilities
- Design and develop scalable ETL/ELT data pipelines using AWS services including AWS Glue, Amazon S3, Lambda, Step Functions, and Amazon Redshift.
- Build ingestion frameworks for structured and semi-structured data from enterprise applications, databases, APIs, files, and streaming sources.
- Develop data transformation and processing solutions using Python, PySpark, and SQL.
- Design and optimize cloud-based data lake and data warehouse solutions on AWS.
- Implement data quality, reconciliation, monitoring, logging, and exception-handling frameworks.
- Create performant data models and datasets to support downstream analytics, reporting, machine learning, and AI use cases.
- Collaborate with business stakeholders, solution architects, data analysts, and application teams to turn business requirements into scalable technical solutions.
- Optimize AWS data workloads for performance, scalability, reliability, and cloud cost.
- Implement security controls using AWS IAM, encryption, secrets management, and role-based access.
- Support CI/CD, automated deployment, production support, troubleshooting, and operational monitoring of data pipelines.
Required skills
- Strong hands-on experience with AWS Glue, Amazon S3, Amazon Redshift, Lambda, IAM, CloudWatch, and Step Functions.
- Strong programming experience in Python and PySpark.
- Advanced SQL experience with large-scale relational and analytical datasets.
- Experience implementing ETL/ELT pipelines, data lakes, data warehouses, and dimensional/data modeling.
- Experience with Apache Spark and distributed data processing.
- Good understanding of AWS security, networking, encryption, and access-control concepts.
- Experience with Git and CI/CD practices for data engineering deployments.
- Strong troubleshooting, performance optimization, and production-support skills.
Technologies
- AWS Glue, Amazon S3, Lambda, Step Functions, Amazon Redshift
- Python, PySpark, SQL
- AWS, data lake, data warehouse
- Amazon IAM (IAM), CloudWatch
- Git, CI/CD, Apache Spark
- Amazon EMR, Kinesis, Athena, Lake Formation, MWAA, Airflow, DynamoDB
- Terraform, AWS CloudFormation
- AWS Certified Data Engineer – Associate
Additional information on the role purpose
The purpose of the role is to develop minimum viable product (MVP) and comprehensive AI solutions that meet and exceed client expectations and add value to the business.
Expected compensation
The expected compensation for this role ranges from $60,000 to $148,500 per year. Final compensation will depend on factors including geographical location, minimum wage obligations, skills, and relevant experience.
Benefits
- Full range of medical and dental benefits options
- Disability insurance
- Paid time off (inclusive of sick leave)
- Other paid and unpaid leave options