Associate Data Engineer

Stanford University is seeking an Associate Data Engineer to design, build, and maintain data pipelines and warehousing solutions that span cloud and hybrid environments. Based onsite in Redwood City, CA, you will translate complex requirements into scalable software, provide technical leadership, and mentor teammates within the data engineering practice. The role offers a salary range of USD 138,402 to 163,985 per year and requires a bachelor's degree with at least five years of relevant experience.

Responsibilities

• Conceptualize, design, implement, and develop solutions for complex systems or programs independently.
• Design and develop applications that involve sophisticated data manipulation; implement and maintain data stores, data lakes, lakehouse architectures, and data warehousing systems that are scalable, optimized, and fault-tolerant.
• Document system architectures and application configurations; maintain and update documentation as needed.
• Provide technical analysis, design, development, conversion, and implementation work.
• Lead projects of moderate complexity as needed.
• Serve as a technical resource for all data engineering applications.
• Compare, evaluate, and implement new features and technologies, integrating them into the computing environment.
• Follow the team software development methodology.
• Mentor lower-level software developers.
• Design and implement data migration and data integration across cloud and hybrid environments.
• Demonstrate mastery and hands-on experience with data engineering technologies and scripting languages.
• Translate complex functional and technical requirements into detailed architecture, design, and high-performing software.
• Design, build, and optimize pipelines for data collection, storage, access, and analytics.

Requirements

• Bachelor's degree and five years of relevant experience, or a combination of education, training, and relevant experience.
• Expertise in designing, developing, testing, and deploying applications.
• Ability to define and solve logical problems for highly technical applications.
• Hands-on experience with Advanced SQL, Advanced Python programming, AWS services (S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC and others), SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud and other open source tools.
• Experience writing reusable complex Python/PySpark scripts for ELT, business logic, or APIs; additional coding experience in Scala or R is a plus.
• Hands-on development across data analysis, data provisioning, modeling, performance tuning, and optimization.
• Experience working in an AWS cloud environment, including tool marketplace selection and efficient utilization to meet business needs.
• Build scalable data pipelines for both real-time and batch processing using sound data modeling and ETL/ELT practices across diverse technology stacks.
• Experience in data modeling, data migration, and data integration, with an understanding of challenges in SaaS data integration and effective solutions.
• Strong communication skills for technical and non-technical stakeholders.

Technologies

• SQL, Python, PySpark, AWS (S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC), SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud, Scala, R

Benefits

• Career development programs
• Tuition reimbursement
• Audit a course opportunities
• Retirement plans
• Generous time off
• Family care resources
• Health care benefits
• Fitness facilities and health classes
• Discovery and access to museums and trails
• Free commuter programs
• Ridesharing incentives
• Discounts
• Onsite cafes and a dining pavilion
• High-end fitness facility with an outdoor pool
• Childcare center for Stanford families
• Redwood City campus amenities including onsite cafes, dining pavilion, fitness facility, outdoor pool, and childcare center

Physical Requirements

• Constantly perform desk-based computer tasks.
• Frequently sit, perform light grasping and fine manipulation.
• Occasionally stand or walk, and use a telephone.
• Rarely engage in handwriting; lift or carry objects up to 10 pounds.

Working Conditions

• May work extended hours, evenings, and weekends.

Work Standards

• Interpersonal skills to collaborate effectively with Stanford colleagues, clients, and external organizations.
• Commitment to safety culture, including identifying safety concerns and promoting safe practices.
• Compliance with all applicable university policies and procedures as outlined in the Administrative Guide.

Why Stanford is for you

• Freedom to grow through career development programs, tuition reimbursement, or auditing courses; opportunities to attend talks, screenings, and author events.
• A caring culture with strong retirement plans, generous time off, and family care resources.
• A healthier you with access to extensive fitness facilities, health classes, and comprehensive health benefits.
• Discovery and fun through sculptures, trails, and museums on campus.
• Enviable resources including free commuter programs, ridesharing incentives, and discounts.
• Redwood City campus, opened in 2019, offering onsite cafes and a dining pavilion, a premium fitness facility with an outdoor pool, and a childcare center for Stanford families.