AWS Cloud Data Engineer

AWS Cloud Data Engineer responsible for designing, building, and maintaining data pipelines and processing solutions in AWS, collaborating with DBAs, data scientists, and business stakeholders to deliver scalable data capabilities.

Responsibilities

• Architect, build, and sustain scalable data pipelines and processing workloads within the AWS environment.
• Partner with the AWS Cloud DBA to deliver end-to-end data solutions that migrate legacy applications to AWS, ensuring performance and reliability.
• Apply hands-on expertise with AWS data services and modern data-architecture patterns while collaborating with DBAs, data scientists, and business stakeholders to deliver scalable solutions.
• Engineer scalable data pipelines using AWS Glue, AWS Step Functions, Lambda, and Kinesis.
• Develop ETL and ELT processes to ingest, transform, and load data from diverse sources into data warehouses and data lakes.
• Architect and manage data lakes on S3, implement cataloging with AWS Glue Catalog, and optimize storage formats such as Parquet and Delta.
• Design data warehouse solutions with Redshift and integrate with RDS/Aurora databases managed by the DBA team.
• Develop real-time and batch processing capabilities using Kinesis Data Streams, Kinesis Analytics, EMR, and AWS Batch.
• Create and maintain data models, schemas, and documentation.
• Collaborate with the DBA team to optimize data access patterns and query performance across relational and analytical databases.
• Implement automated data quality checks, monitoring, and alerting mechanisms.
• Enforce data governance policies and ensure compliance with data retention, privacy, and security requirements.

Requirements

• U.S. Citizenship or Green Card is required.
• Must obtain and maintain a Federal or DoD Public Trust; adjudication approved prior to onboarding; active Public Trust or Suitability is preferred.
• Bachelor’s degree in computer science, data engineering, or a related field; an equivalent of four years of additional related experience may be used in lieu of the degree.
• Minimum six (6) years of data engineering experience, including at least three (3) years in AWS cloud environments.
• Strong expertise with AWS data services such as S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, and Lambda.
• Proficiency in Python, Scala, or Java for data processing and pipeline development.
• Experience with SQL and working knowledge of relational databases (PostgreSQL, Oracle) and NoSQL systems (DynamoDB, DocumentDB).
• Understanding of data modeling concepts for transactional and analytical workloads.
• Experience with Infrastructure as Code tools (Terraform, CloudFormation, CDK) and CI/CD pipelines for data workflows.
• Strong analytical and problem-solving skills with emphasis on data quality and system reliability.
• Proven ability to work collaboratively with DBAs, data scientists, and business stakeholders.

Technologies

• AWS data services: S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, Lambda
• Programming: Python, Scala, Java
• Databases: PostgreSQL, Oracle, DynamoDB, DocumentDB
• Data formats: Parquet, Delta, ORC
• Data warehousing: Redshift, RDS, Aurora
• Orchestration/Workflow: AWS Glue Catalog, Apache Spark
• Infrastructure as Code: Terraform, CloudFormation, CDK
• CI/CD: pipelines for data engineering workflows
• Streaming/Processing: Kinesis Data Streams, Kinesis Analytics, AWS Batch
• Containers/Orchestration: Docker, Kubernetes (ECS, EKS)
• BI/Visualization: QuickSight, Tableau, PowerBI
• Data formats: JSON, Avro, ORC

Benefits

• Medical, Rx, Dental & Vision Insurance
• Personal and Family Sick Time & Company Paid Holidays
• Parental Leave
• 401(k) Retirement Plan
• Group Term Life and Travel Assistance
• Voluntary Life and AD&D Insurance
• Health Savings Account and Flexible Spending Accounts
• Transit and Parking Commuter Benefits
• Short-Term and Long-Term Disability
• Tuition Reimbursement and Learning Opportunities
• Employee Referral Program
• Corporate Sponsored Events and Community Outreach
• Care.com annual membership
• Employee Assistance Program
• Supplemental Benefits via Corestream
• Potential discretionary incentive bonus

Job Family

Software Development & Support

Travel

Up to 10% travel required.

Security Clearance

Ability to Obtain Public Trust