Delta Engineer Jobs

1 job found

18d ago

AWS Cloud Data Engineer

Guidehouse San Antonio, TX

San Antonio, TX

18d ago

Full time Amazon Emr Amazon Web Services AWS

Apply Now

Job Description

AWS Cloud Data Engineer responsible for designing, building, and maintaining data pipelines and processing solutions in AWS, collaborating with DBAs, data scientists, and business stakeholders to deliver scalable data capabilities.

Responsibilities

Architect, build, and sustain scalable data pipelines and processing workloads within the AWS environment.
Partner with the AWS Cloud DBA to deliver end-to-end data solutions that migrate legacy applications to AWS, ensuring performance and reliability.
Apply hands-on expertise with AWS data services and modern data-architecture patterns while collaborating with DBAs, data scientists, and business stakeholders to deliver scalable solutions.
Engineer scalable data pipelines using AWS Glue, AWS Step Functions, Lambda, and Kinesis.
Develop ETL and ELT processes to ingest, transform, and load data from diverse sources into data warehouses and data lakes.
Architect and manage data lakes on S3, implement cataloging with AWS Glue Catalog, and optimize storage formats such as Parquet and Delta.
Design data warehouse solutions with Redshift and integrate with RDS/Aurora databases managed by the DBA team.
Develop real-time and batch processing capabilities using Kinesis Data Streams, Kinesis Analytics, EMR, and AWS Batch.
Create and maintain data models, schemas, and documentation.
Collaborate with the DBA team to optimize data access patterns and query performance across relational and analytical databases.
Implement automated data quality checks, monitoring, and alerting mechanisms.
Enforce data governance policies and ensure compliance with data retention, privacy, and security requirements.

Requirements

U.S. Citizenship or Green Card is required.
Must obtain and maintain a Federal or DoD Public Trust; adjudication approved prior to onboarding; active Public Trust or Suitability is preferred.
Bachelor’s degree in computer science, data engineering, or a related field; an equivalent of four years of additional related experience may be used in lieu of the degree.
Minimum six (6) years of data engineering experience, including at least three (3) years in AWS cloud environments.
Strong expertise with AWS data services such as S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, and Lambda.
Proficiency in Python, Scala, or Java for data processing and pipeline development.
Experience with SQL and working knowledge of relational databases (PostgreSQL, Oracle) and NoSQL systems (DynamoDB, DocumentDB).
Understanding of data modeling concepts for transactional and analytical workloads.
Experience with Infrastructure as Code tools (Terraform, CloudFormation, CDK) and CI/CD pipelines for data workflows.
Strong analytical and problem-solving skills with emphasis on data quality and system reliability.
Proven ability to work collaboratively with DBAs, data scientists, and business stakeholders.

Technologies

AWS data services: S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, Lambda
Programming: Python, Scala, Java
Databases: PostgreSQL, Oracle, DynamoDB, DocumentDB
Data formats: Parquet, Delta, ORC
Data warehousing: Redshift, RDS, Aurora
Orchestration/Workflow: AWS Glue Catalog, Apache Spark
Infrastructure as Code: Terraform, CloudFormation, CDK
CI/CD: pipelines for data engineering workflows
Streaming/Processing: Kinesis Data Streams, Kinesis Analytics, AWS Batch
Containers/Orchestration: Docker, Kubernetes (ECS, EKS)
BI/Visualization: QuickSight, Tableau, PowerBI
Data formats: JSON, Avro, ORC

Benefits

Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Parental Leave
401(k) Retirement Plan
Group Term Life and Travel Assistance
Voluntary Life and AD&D Insurance
Health Savings Account and Flexible Spending Accounts
Transit and Parking Commuter Benefits
Short-Term and Long-Term Disability
Tuition Reimbursement and Learning Opportunities
Employee Referral Program
Corporate Sponsored Events and Community Outreach
Care.com annual membership
Employee Assistance Program
Supplemental Benefits via Corestream
Potential discretionary incentive bonus

Job Family

Software Development & Support

Travel

Up to 10% travel required.

Security Clearance

Ability to Obtain Public Trust

View full job page →

Get Delta Engineer Jobs alerts

New Delta Engineer Jobs, daily.