EngineerJobs.io
← Back to all jobs

Job Description

The Senior Data Engineer role at Innovya Technologies focuses on the design, construction, and ongoing reliability of scalable data pipelines and cloud-based data platforms. The position supports ETL workflows, data modeling, warehousing, performance tuning, monitoring, and data security and governance for analytics and reporting.

Responsibilities

  • Design, build, and maintain scalable data pipelines using PySpark, Databricks, and related cloud data platforms.
  • Implement robust ETL workflows.
  • Develop and optimize data models to support reliable downstream analytics.
  • Support data warehousing initiatives to ensure analytics and reporting are powered by dependable, high-quality data.
  • Work closely with data analysts, data scientists, and product teams to capture data requirements, improve data accessibility, and strengthen the overall data architecture.
  • Perform performance tuning and monitoring of data systems; ensure data security and governance; contribute to best practices and documentation.

Requirements

  • Strong data engineering background, including experience building and maintaining scalable data pipelines.
  • Proficiency in data modeling and data warehousing to design efficient, dependable data structures and storage solutions.
  • Hands-on experience with Extract Transform Load (ETL) processes and frameworks for integrating data from multiple sources.
  • Applied data analytics experience to support reporting, dashboards, and data-driven decision-making.
  • Advanced experience with PySpark, Databricks, and Python for data processing and automation.
  • Experience with cloud data platforms such as AWS, Azure, or GCP, as well as distributed processing frameworks.
  • Knowledge of SQL and NoSQL databases, including performance tuning and data optimization techniques.
  • Understanding of data governance, data quality, and security best practices.
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; equivalent experience may be considered.
  • Ability to collaborate with cross-functional teams and clearly communicate complex data concepts.

Key Technologies

  • PySpark
  • Databricks
  • Python
  • ETL
  • SQL
  • NoSQL
  • AWS
  • Azure
  • GCP

Compensation

USD 124,000 - 150,000 per year.

Work Location

Hybrid remote in Pasadena, CA 91185.

Similar Jobs