Lead Data Engineer
Backend Developer
Artificial Intelligence
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
ETL
Informatica
Integration
Lead Data Engineering
Programming Language
Programming Languages
Pyspark
Reporting and Analytics
SQL
Job Description
Lead Data Engineer position for the Leasing Data Engineering group, focused on data architecture, cloud platform modernization, and AI-ready solutions for leasing transaction and related datasets.
Responsibilities
- Design and deliver data models and architecture for leasing transaction, broker, CRM, and market availability data
- Build and optimize cloud-based pipelines and platform components on Azure and/or AWS, migrating siloed sources into a unified, governed data layer
- Develop robust, fault-tolerant batch and incremental data pipelines using Python/PySpark and SQL with production readiness
- Create data products, semantic structures, and API/MCP interfaces to support AI systems and analytics applications
- Implement integration services and APIs to expose leasing data to enterprise applications and downstream consumers
Requirements
- 7+ years of experience in data engineering and Big Data development, with a track record of delivering complex projects
- Hands-on experience with Azure or AWS cloud data platforms, including Databricks, Data Factory, Synapse, Glue, or EMR
- Advanced proficiency in Python and SQL, plus expertise in PySpark/Spark for distributed processing at scale
- Strong skills in data modeling and architecture, including experience with SQL and NoSQL databases
- Experience designing and building API services and integrating data platforms with downstream applications, including familiarity with AI/agentic workflows and MCP integrations
Technologies
- Azure, AWS
- Databricks, Data Factory, Synapse, Glue, EMR
- Python, PySpark, Spark
- SQL, NoSQL
- API, MCP
- AI
Benefits
- Medical and Prescription Drug Plans
- Dental Plan
- Vision Plan
- Health Savings Account
- Health Flexible Spending Account
- Dependent Care Flexible Spending Account
- Supplemental Life Insurance
- Short Term and Long Term Disability Insurance
- Business Travel Insurance
- 401(k), Plus Match
- Weekly Pay
Location: Westmont, IL (onsite)
Pay range: USD 70–75 per hour
Minimum experience: 7 years