Senior Data Engineer (Modern Data Platforms)

Senior Data Engineer to lead the design and delivery of modern, cloud-based data platforms for clients, operating at both strategic and technical levels across Azure, AWS, Databricks, and Microsoft Fabric.

Responsibilities

• Design and implement modern data platforms, including lakehouse architectures, data mesh concepts, and warehouse modernization initiatives.
• Define data platform strategy, roadmaps, and best practices tailored to client needs.
• Develop solutions using Azure services (Fabric, Synapse, Data Factory), AWS services (S3, Glue, Redshift), and Databricks.
• Lead teams to build scalable, secure, and cost-efficient data pipelines and platforms.
• Act as a trusted advisor to clients, translating business goals into technical architectures.
• Establish and enforce data governance, security, and compliance frameworks.
• Guide key decisions on data modeling, ingestion patterns, storage, and processing approaches.
• Promote modern engineering practices such as CI/CD, DevOps, and Infrastructure as Code.
• Mentor and coach engineers to foster technical growth and delivery excellence.
• Contribute to pre-sales, solutioning, and proposal development as needed.

Requirements

• Proven experience in data engineering or closely related roles.
• Track record delivering enterprise-scale data platforms in cloud environments.
• Deep expertise with Azure and/or AWS ecosystems.
• Hands-on experience with Databricks and/or Microsoft Fabric.
• Advanced proficiency in Python, SQL, and distributed data processing (Spark/PySpark).
• Strong understanding of data modeling approaches (Kimball, Data Vault, lakehouse patterns).
• Experience designing, orchestrating, and optimizing ETL/ELT at scale.
• Knowledge of data governance, security, and regulatory considerations.
• Experience leading technical teams and mentoring engineers.
• Excellent communication skills for engaging both technical and business stakeholders.

Technologies

• Azure
• Azure Synapse
• Azure Data Factory
• Azure Fabric / Microsoft Fabric
• S3
• Glue
• Redshift
• Databricks
• Python
• SQL
• Spark / PySpark

Benefits

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Professional development assistance
• Retirement plan
• Vision insurance

About the role

• Improving is seeking a Senior Data Engineer to lead the design and delivery of modern, cloud-based data platforms for clients.
• This role suits a hands-on leader capable of operating at strategic and technical levels, guiding delivery teams and building strong client relationships.
• You will shape enterprise data solutions while leveraging Azure, AWS, Databricks, and Microsoft Fabric to deliver scalable, high-performing platforms.

Nice to have

• Experience with real-time streaming technologies (Kafka, Event Hubs, Kinesis).
• Familiarity with data mesh or domain-driven data approaches.
• Experience with AI/ML data pipelines or MLOps.
• Cloud certifications (Azure, AWS, Databricks).
• Experience in a consulting or client-facing environment.

What success looks like

• Design and deliver scalable, future-proof data solutions.
• Earn the trust of clients as a technical advisor.
• Elevate the capabilities of the team through mentorship and leadership.
• Drive innovation and adoption of modern data practices across engagements.

Why Improving

• Influence enterprise data solutions for a diverse set of clients.
• Work with modern technologies across multiple cloud platforms.
• Grow career through our PATH program and leadership opportunities.
• Join a collaborative team that values technical excellence and strong relationships.

Pay

Salary: USD 150,000 - 175,000 per year

Work Location

Hybrid remote in Alpharetta, GA 30009