Senior Data Engineer

CGI is hiring a Senior Data Engineer (remote within the USA) to lead data platform testing for enterprise ETL/ELT pipelines and ensure end-to-end data quality.

Responsibilities

• Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions
• Run end-to-end ETL testing and validate data accuracy, completeness, transformation logic, and reconciliation across source and target systems
• Create and execute complex SQL queries for backend testing and data validation
• Test large scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF)
• Perform functional, integration, regression, system, and data quality testing across data pipelines and applications
• Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments
• Identify, document, track, and retest defects by coordinating with developers, data engineers, business analysts, and other stakeholders through resolution
• Develop and maintain reusable test scripts and automation solutions where applicable
• Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives

Requirements

• 8+ years of experience in software quality engineering/testing with strong experience in ETL testing, data validation, integration testing, and regression testing
• Strong hands-on SQL skills, including complex query development for source to target validation, reconciliation, and data quality testing
• Experience testing large scale data platforms and ETL/ELT pipelines
• Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF)
• Experience with the Hadoop ecosystem, including Hadoop/HDFS and Hive
• Experience with Unix/Linux and enterprise job scheduling tools such as Control M
• Strong understanding of data quality concepts, data transformations, data mappings, and source to target validation
• Experience with defect management and test management processes within Agile/Scrum delivery environments
• Strong analytical, troubleshooting, communication, and collaboration skills

Technologies

• Databricks
• Apache Spark
• PySpark
• Python
• Hive
• Hadoop/HDFS
• Azure Data Factory (ADF)
• SQL
• Control M
• Unix/Linux
• Agile/Scrum

Benefits

• Competitive compensation including profit participation program
• Comprehensive medical, dental, and vision benefits
• Basic life and accidental death & dismemberment insurance
• 401(k) matching contributions and CGI share purchase plan
• Flexibility and paid accrued vacation leave, ranging from 10 to 20 days per year based on job level, years of relevant prior experience, and years of service
• 10 paid holidays per year
• At least 80 consecutive hours of paid sick/safe leave (with exceptions where applicable state/local law requires more)
• Paid parental leave, ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws
• Bereavement leave, ranging from 1 to 7 days per year based on relationship
• Paid jury duty leave, up to time summoned
• Learning opportunities and tuition assistance
• Wellness and Well being programs

Compensation: USD 62,900 - 139,300 per yearly
Location: Oregon (remote)
Minimum experience: 8 years