Glue Etl Engineer Jobs

1 job found

5d ago

Associate Data Engineer

Stanford University Redwood City, CA

Redwood City, CA

5d ago

$138k - $164k/yr Full time Apache Airflow Automation Big Data

Apply Now

Job Description

Stanford University is seeking an Associate Data Engineer to design, build, and maintain data pipelines and warehousing solutions that span cloud and hybrid environments. Based onsite in Redwood City, CA, you will translate complex requirements into scalable software, provide technical leadership, and mentor teammates within the data engineering practice. The role offers a salary range of USD 138,402 to 163,985 per year and requires a bachelor's degree with at least five years of relevant experience.

Responsibilities

Conceptualize, design, implement, and develop solutions for complex systems or programs independently.
Design and develop applications that involve sophisticated data manipulation; implement and maintain data stores, data lakes, lakehouse architectures, and data warehousing systems that are scalable, optimized, and fault-tolerant.
Document system architectures and application configurations; maintain and update documentation as needed.
Provide technical analysis, design, development, conversion, and implementation work.
Lead projects of moderate complexity as needed.
Serve as a technical resource for all data engineering applications.
Compare, evaluate, and implement new features and technologies, integrating them into the computing environment.
Follow the team software development methodology.
Mentor lower-level software developers.
Design and implement data migration and data integration across cloud and hybrid environments.
Demonstrate mastery and hands-on experience with data engineering technologies and scripting languages.
Translate complex functional and technical requirements into detailed architecture, design, and high-performing software.
Design, build, and optimize pipelines for data collection, storage, access, and analytics.

Requirements

Bachelor's degree and five years of relevant experience, or a combination of education, training, and relevant experience.
Expertise in designing, developing, testing, and deploying applications.
Ability to define and solve logical problems for highly technical applications.
Hands-on experience with Advanced SQL, Advanced Python programming, AWS services (S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC and others), SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud and other open source tools.
Experience writing reusable complex Python/PySpark scripts for ELT, business logic, or APIs; additional coding experience in Scala or R is a plus.
Hands-on development across data analysis, data provisioning, modeling, performance tuning, and optimization.
Experience working in an AWS cloud environment, including tool marketplace selection and efficient utilization to meet business needs.
Build scalable data pipelines for both real-time and batch processing using sound data modeling and ETL/ELT practices across diverse technology stacks.
Experience in data modeling, data migration, and data integration, with an understanding of challenges in SaaS data integration and effective solutions.
Strong communication skills for technical and non-technical stakeholders.

Technologies

SQL, Python, PySpark, AWS (S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC), SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud, Scala, R

Benefits

Career development programs
Tuition reimbursement
Audit a course opportunities
Retirement plans
Generous time off
Family care resources
Health care benefits
Fitness facilities and health classes
Discovery and access to museums and trails
Free commuter programs
Ridesharing incentives
Discounts
Onsite cafes and a dining pavilion
High-end fitness facility with an outdoor pool
Childcare center for Stanford families
Redwood City campus amenities including onsite cafes, dining pavilion, fitness facility, outdoor pool, and childcare center

Physical Requirements

Constantly perform desk-based computer tasks.
Frequently sit, perform light grasping and fine manipulation.
Occasionally stand or walk, and use a telephone.
Rarely engage in handwriting; lift or carry objects up to 10 pounds.

Working Conditions

May work extended hours, evenings, and weekends.

Work Standards

Interpersonal skills to collaborate effectively with Stanford colleagues, clients, and external organizations.
Commitment to safety culture, including identifying safety concerns and promoting safe practices.
Compliance with all applicable university policies and procedures as outlined in the Administrative Guide.

Why Stanford is for you

Freedom to grow through career development programs, tuition reimbursement, or auditing courses; opportunities to attend talks, screenings, and author events.
A caring culture with strong retirement plans, generous time off, and family care resources.
A healthier you with access to extensive fitness facilities, health classes, and comprehensive health benefits.
Discovery and fun through sculptures, trails, and museums on campus.
Enviable resources including free commuter programs, ridesharing incentives, and discounts.
Redwood City campus, opened in 2019, offering onsite cafes and a dining pavilion, a premium fitness facility with an outdoor pool, and a childcare center for Stanford families.

View full job page →

Get Glue Etl Engineer Jobs alerts

New Glue Etl Engineer Jobs, daily.