EngineerJobs.io
← Back to all jobs

Job Description

Robotics Technologies is seeking a Senior Data Engineer to support onsite work in Sunnyvale, CA. This contract role centers on building and improving scalable data platforms using Databricks and AWS, with an emphasis on reliable ETL/ELT and lakehouse and warehouse architectures.

You will design engineering pipelines, implement data processing workloads with Python, PySpark, and SQL, and collaborate with architects, analysts, and business stakeholders to deliver centralized data capabilities. The position also involves production support, troubleshooting, and performance tuning across large-scale datasets.

Responsibilities

  • Design, develop, and maintain scalable data engineering pipelines.
  • Build ETL/ELT workflows using Python, PySpark, and SQL.
  • Develop data processing solutions using Databricks and AWS.
  • Implement data lakehouse and data warehouse architectures.
  • Optimize Spark jobs and large-scale data processing workloads.
  • Implement data quality checks and data governance practices.
  • Integrate enterprise data sources into centralized data platforms.
  • Collaborate with architects, analysts, and business stakeholders on data solutions.
  • Support production deployments, troubleshooting, and performance tuning.

Requirements

  • 8+ years of experience in Data Engineering.
  • Strong experience with Python, PySpark, and SQL.
  • Hands-on experience with Databricks and Delta Lake.
  • Strong knowledge of ETL/ELT pipeline development.
  • Experience with AWS services including S3, Glue, Lambda, Redshift, and EMR.
  • Experience with Snowflake or other cloud data warehouses.
  • Strong knowledge of data modeling and data warehousing.
  • Experience with Apache Spark and distributed data processing.
  • Knowledge of data integration and orchestration tools.
  • Experience with Git, Jenkins, and CI/CD pipelines.
  • Strong understanding of data quality, performance tuning, and optimization.

Key Technologies

  • Databricks, Databricks Lakehouse architecture, Unity Catalog
  • Delta Lake, Delta Live Tables, Databricks Workflows
  • Databricks Genie, Databricks Genie Agents
  • Model Context Protocol (MCP), Text-to-SQL, Vector search, RAG
  • Python, PySpark, SQL, Apache Spark
  • AWS: Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Amazon EMR
  • Snowflake
  • Git, Jenkins, CI/CD, Infrastructure as Code, Terraform
  • Data pipeline observability and monitoring

Compensation: USD 67 per hour.

Similar Jobs