Design and scale enterprise data pipelines and storage for a centralized data platform in a hybrid Chicago role.

Lead the design, architecture, and implementation of complex data pipelines and storage solutions
Build and optimize a centralized data platform and enterprise data model to keep data ready for analysis and reporting
Mentor teammates and provide technical guidance across the engineering team
Evaluate and recommend new data technologies and tools to improve efficiency
Collaborate with data scientists to optimize and scale machine learning workflows
Implement advanced data transformations and aggregation processes
Drive data engineering best practices, standards, and implementation patterns
Participate in cross-functional project planning and execution
Manage and optimize cloud resources and costs tied to data processing
Improve data quality, data lineage, and metadata management
Partner with business stakeholders to understand, prioritize, and align data needs to strategic initiatives

6+ years of relevant experience in data engineering or a related field
Bachelor’s degree in Computer Science, Software/Computer Engineering, Mathematics, or related discipline; Master’s or higher is a plus
Advanced proficiency in Python and SQL; expert proficiency in alternative general programming languages is considered
Extensive experience with data orchestration tools such as Prefect or Airflow
Strong background in data transformation and modeling tools like dbt, and warehouse/processing technologies such as Snowflake and BigQuery or Apache Spark
Extensive experience with version control systems and CI/CD tools
Hands-on experience with a major cloud platform required; Azure preferred
Leadership skills for mentoring and guiding junior team members
Problem-solving skills for complex data engineering challenges
Effective communication skills for cross-functional collaboration
Project management abilities to oversee multiple data projects

Ability to hear and speak well enough to converse verbally over the phone and in-person
Ability to interpret, evaluate, and communicate detailed written or verbal instructions accurately
Ability to see well enough to use a computer and read written communications
Ability to lift, push, pull, or carry up to 15 pounds to disseminate documents, supplies, or materials
May be required to climb stairs depending on the property structure

Sr Data Engineer

Job Description