Senior Data Engineer β Databricks & AWS
Senior
Aws Data Engineer
Aws Data Engineering
Azure Databricks
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Genie
Databricks Lakehouse
Databricks Lakehouse Platform
Databricks Pyspark
Databricks Workflows
Delta Lake
ETL
Informatica
Information Technology (IT)
Programming Language
Programming Languages
Software Development
Spark
SQL
Job Description
Robotics Technologies is seeking a Senior Data Engineer to support onsite work in Sunnyvale, CA. This contract role centers on building and improving scalable data platforms using Databricks and AWS, with an emphasis on reliable ETL/ELT and lakehouse and warehouse architectures.
You will design engineering pipelines, implement data processing workloads with Python, PySpark, and SQL, and collaborate with architects, analysts, and business stakeholders to deliver centralized data capabilities. The position also involves production support, troubleshooting, and performance tuning across large-scale datasets.
Responsibilities
- Design, develop, and maintain scalable data engineering pipelines.
- Build ETL/ELT workflows using Python, PySpark, and SQL.
- Develop data processing solutions using Databricks and AWS.
- Implement data lakehouse and data warehouse architectures.
- Optimize Spark jobs and large-scale data processing workloads.
- Implement data quality checks and data governance practices.
- Integrate enterprise data sources into centralized data platforms.
- Collaborate with architects, analysts, and business stakeholders on data solutions.
- Support production deployments, troubleshooting, and performance tuning.
Requirements
- 8+ years of experience in Data Engineering.
- Strong experience with Python, PySpark, and SQL.
- Hands-on experience with Databricks and Delta Lake.
- Strong knowledge of ETL/ELT pipeline development.
- Experience with AWS services including S3, Glue, Lambda, Redshift, and EMR.
- Experience with Snowflake or other cloud data warehouses.
- Strong knowledge of data modeling and data warehousing.
- Experience with Apache Spark and distributed data processing.
- Knowledge of data integration and orchestration tools.
- Experience with Git, Jenkins, and CI/CD pipelines.
- Strong understanding of data quality, performance tuning, and optimization.
Key Technologies
- Databricks, Databricks Lakehouse architecture, Unity Catalog
- Delta Lake, Delta Live Tables, Databricks Workflows
- Databricks Genie, Databricks Genie Agents
- Model Context Protocol (MCP), Text-to-SQL, Vector search, RAG
- Python, PySpark, SQL, Apache Spark
- AWS: Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Amazon EMR
- Snowflake
- Git, Jenkins, CI/CD, Infrastructure as Code, Terraform
- Data pipeline observability and monitoring
Compensation: USD 67 per hour.