Senior Data Engineer
Job Description
The Senior Data Engineer role at Innovya Technologies focuses on the design, construction, and ongoing reliability of scalable data pipelines and cloud-based data platforms. The position supports ETL workflows, data modeling, warehousing, performance tuning, monitoring, and data security and governance for analytics and reporting.
Responsibilities
- Design, build, and maintain scalable data pipelines using PySpark, Databricks, and related cloud data platforms.
- Implement robust ETL workflows.
- Develop and optimize data models to support reliable downstream analytics.
- Support data warehousing initiatives to ensure analytics and reporting are powered by dependable, high-quality data.
- Work closely with data analysts, data scientists, and product teams to capture data requirements, improve data accessibility, and strengthen the overall data architecture.
- Perform performance tuning and monitoring of data systems; ensure data security and governance; contribute to best practices and documentation.
Requirements
- Strong data engineering background, including experience building and maintaining scalable data pipelines.
- Proficiency in data modeling and data warehousing to design efficient, dependable data structures and storage solutions.
- Hands-on experience with Extract Transform Load (ETL) processes and frameworks for integrating data from multiple sources.
- Applied data analytics experience to support reporting, dashboards, and data-driven decision-making.
- Advanced experience with PySpark, Databricks, and Python for data processing and automation.
- Experience with cloud data platforms such as AWS, Azure, or GCP, as well as distributed processing frameworks.
- Knowledge of SQL and NoSQL databases, including performance tuning and data optimization techniques.
- Understanding of data governance, data quality, and security best practices.
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; equivalent experience may be considered.
- Ability to collaborate with cross-functional teams and clearly communicate complex data concepts.
Key Technologies
- PySpark
- Databricks
- Python
- ETL
- SQL
- NoSQL
- AWS
- Azure
- GCP
Compensation
USD 124,000 - 150,000 per year.
Work Location
Hybrid remote in Pasadena, CA 91185.