Date Engineer Lead(Big Data)

Benefits and culture

CGI offers a benefits-forward environment that prioritizes ownership, teamwork, respect and belonging. In addition to competitive pay, you gain access to comprehensive benefits and ongoing learning opportunities that support your growth and well-being.

• Competitive compensation
• Comprehensive insurance options
• Matching contributions through the 401(k) plan and the share purchase plan
• Paid time off for vacation, holidays, and sick time
• Paid parental leave
• Learning opportunities and tuition assistance
• Wellness and Well-Being programs

Location and role focus

This onsite role requires five days per week at client sites in Pittsburgh, PA; Cleveland, OH; Birmingham, AL; or Dallas, TX. The Lead Data Engineer will design, build and optimize real-time analytics solutions and streaming pipelines using Kafka, Flink, Spark, Hadoop and SQL.

Responsibilities

• Design and implement low-latency, high-throughput streaming pipelines with Kafka, Flink, and Spark Streaming
• Build and maintain event-driven architectures for real-time data ingestion and processing
• Develop stateful and stateless stream processing applications using Flink and Spark Structured Streaming
• Collaborate with application teams to define integration points and API specifications

Requirements

• 10+ years of hands-on data engineering experience
• Proven track record in building streaming pipelines
• Hands-on expertise with Hadoop ecosystem, Kafka, Flink, Spark Streaming and SQL
• Proficiency in Scala and Python
• Experience with Oracle Database, SQL, and PL/SQL
• Familiarity with CI/CD tools (Git, Bitbucket, uDeploy, ServiceNow)
• Strong verbal and written communication skills with client-facing capabilities
• Experience in client-facing or consulting roles
• Strong problem-solving and analytical thinking
• Ability to manage multiple priorities in a fast-paced environment
• Collaborative mindset with leadership capabilities
• Experience building enterprise-scale data platforms
• Exposure to cloud-based data ecosystems (AWS, Azure, or GCP)
• Knowledge of data governance, security, and compliance practices
• Experience mentoring junior team members

Ideal candidate profile

• Thinks beyond code and understands business impact
• Leads conversations and owns end-to-end solutions
• Balances technical depth with strong interpersonal skills
• Comfortable taking ownership of solutions from conception to delivery

Technologies

• Apache Kafka
• Flink
• Spark Streaming
• Spark Structured Streaming
• Hadoop and Hadoop Ecosystem (HDFS)
• SQL
• Python
• Scala
• RESTful APIs
• Oracle Database
• PL/SQL
• Git
• Bitbucket
• uDeploy
• ServiceNow
• AWS
• Azure
• GCP

Compensation

Salary: USD 70,800 - 156,700 per year