EngineerJobs.io
← Back to all jobs
Consumers Energy

Sr Data Engineer

Consumers Energy
Jackson, MI Full time Posted 5d ago
Senior Big Data Data Architecture Data Engineer Data Engineering Data Pipeline Data Pipelines Data Warehouse Databricks Databricks Workflows ETL Lakehouse
Apply Now

Job Description

The Senior Data Engineer works with analytics and business partners to gather data requirements and design, build, and improve data pipeline and warehouse solutions.

Responsibilities

  • Provide technical leadership for incident management and deliver technical consulting/support for current applications and solutions
  • Assemble and clean BIG data, working with complex data sets from multiple sources to support medium to large enhancements and IT projects
  • Capture and evaluate requirements from the data architect and/or business partner
  • Review development alternatives and establish project timelines
  • Build analytic tools that use the data pipeline to generate actionable insights for customer acquisition, operational efficiency, and other key business performance metrics
  • Partner with stakeholders and IT to design and build efficient data pipelines for medium to large enhancements and IT projects
  • Design and create complex data visualizations using reporting tools to support customer insight and operational efficiency metrics
  • Prepare, review, and/or approve solution artifacts and document activities
  • Provide technical expertise across solution alternatives, design, testing, and documentation for medium to large enhancements and IT projects
  • Identify and improve internal processes to automate manual data wrangling, optimize performance, and improve data quality
  • Perform other duties as assigned or needed

Requirements

  • Understanding of data test methodologies and testing tools
  • Understanding of database management principles, including data structures, data modeling, data warehousing, and transaction processing
  • Knowledge of data design principles and approaches, applying systems engineering concepts such as supportability, survivability, reliability, scalability, and maintainability
  • Excellent verbal and written communication skills; ability to work with all levels of the organization
  • Proficiency establishing and maintaining working relationships with business and IT teams
  • Knowledge of project planning and full lifecycle delivery using the Agile framework
  • Ability to work effectively with contract employees and vendors
  • Knowledge of change and release tools and processes used to implement solutions across multiple teams and technologies
  • Education and experience:
    • Bachelor’s Degree in Data Engineering, Computer Science, Engineering, Data Sciences or related field, with four (4) or more years in Data Engineer or Software Engineer, including experience as an Intermediate Data Engineer
    • OR Associate Degree in the same fields, with six (6) or more years in Data Engineer or Software Engineer, including experience as an Intermediate Data Engineer
    • OR High School Diploma or GED with eight (8) or more years in Data Engineer or Software Engineer, including experience as an Intermediate Data Engineer
  • Advanced analytic tool build; data architecture/design; defining user requirements; building BIG data pipelines
  • Understanding of ETL tool extraction and basic data testing aptitude
  • Understanding of analytic tool deployment processes and best practices
  • Immigration sponsorship not available (e.g., H-1B, TN, etc.)

Technologies

  • Databricks
  • Lakehouse Architecture
  • Delta Lake
  • Delta Live Tables (DLT)
  • Structured Streaming
  • Unity Catalog
  • Databricks Workflows
  • Databricks Asset Bundles
  • Medallion Architecture
  • Star schema

Preferred Experience

  • Demonstrated experience designing and supporting scalable enterprise data platforms using Databricks and Lakehouse Architecture
  • Experience leveraging Delta Lake, Delta Live Tables (DLT), Structured Streaming, Unity Catalog, Databricks Workflows, and Databricks Asset Bundles
  • Strong understanding of Medallion Architecture and dimensional data modeling, including star schema design
  • Experience establishing data quality, governance, and validation standards
  • Experience with CI/CD automation and DevOps methodologies for data engineering and analytics solutions

Benefits

  • Competitive compensation packages
  • Medical, Dental and Vision
  • 401k with company match
  • Paid parental leave
  • Up to 13 paid Holidays
  • Paid time off
  • Educational Assistance Program

Location and Work Model

  • Jackson, MI, US (hybrid)
  • Required onsite days: Monday, Tuesday, and Thursday
  • Onsite location: One Energy Plaza, Jackson, MI
  • Candidate must be within commutable distance or willing to relocate (relocation package available for those who qualify)

Similar Jobs