IT Data Engineer

The IT Data Engineer will design, build, and maintain enterprise data capabilities using Microsoft Fabric, supporting a scalable architecture for data pipelines, governance, and accessibility. This onsite role in Kansas City focuses on reliable integrations, data validation, performance monitoring, and collaboration with data consumers and source system owners.

Role Overview

This position is responsible for implementing and maintaining the enterprise data architecture within Microsoft Fabric. The work includes creating scalable data pipelines, applying medallion architecture in lakehouses, and ensuring data quality through validation and transformation processes. The engineer also supports deployed machine learning models by maintaining dependable data pipelines for both model training and inference.

Key Responsibilities

• Design and implement a data mesh architecture using Microsoft Fabric’s OneLake Lakehouses, including data governance and security measures
• Establish data transformation processes to support data quality and consistency
• Develop and maintain both synchronous (real-time) and batch data integration processes, including unidirectional and bidirectional data flows as required
• Develop and maintain API and delta connections to enable system interoperability
• Implement data validation processes to support successful data exchange between systems
• Monitor system performance, compute resources, and storage utilization
• Troubleshoot and resolve data pipeline failures and performance bottlenecks
• Maintain comprehensive documentation covering data architecture, pipelines, and processes
• Collaborate across departments to identify data synergies and opportunities
• Monitor and maintain deployed machine learning models
• Document machine learning model data dependencies, pipelines, and infrastructure requirements
• Support machine learning model development by ensuring reliable data pipelines for model training and inference

Required Qualifications

• Ability to perform work accurately and completely, and in a timely manner
• Communication skills, verbal and written
• Time management skills
• Ability to prioritize multiple projects
• Ability to drive change through innovation and process improvement
• Ability to communicate to executive audiences and deliver results through influence
• Proficiency in MS Office (Intermediate)
• Proficiency in SQL (Intermediate)
• Proficiency in Python (Intermediate)
• Proficiency in Spark (Intermediate)
• Experience implementing data mesh architecture and medallion models
• Experience with various data integration patterns and technologies
• Knowledge of data governance and security best practices

Preferred Knowledge, Skills, & Abilities

• Experience developing and consuming REST APIs for data integration (Preferred)
• Familiarity with Power BI and Microsoft Fabric (Preferred)
• Experience with Microsoft Purview or similar data catalog and governance tools (Preferred)
• Understanding of machine learning concepts and MLOps (Preferred)

Education & Experience

• Minimum experience: 2 years
• Education: Bachelor’s degree in computer science, data engineering, data science or related field
• In lieu of the above requirements, equivalent relevant experience will be considered

Technology & Tools

• Microsoft Fabric
• Microsoft Fabric’s OneLake Lakehouses
• SQL
• Python
• Spark
• REST APIs
• Power BI
• Microsoft Purview

Autonomy & Decision-Making

Provides decisions on non-routine matters, offers recommendations to a supervisor, and refers exceptions to the supervisor.

Career Path

• Senior Data Engineer

Location & Work Environment

• Location: Kansas City, MO, US (onsite)
• Normal office environment
• Frequent activity: sitting, viewing a computer screen
• Occasional activity: standing, walking, bending, reaching above shoulder
• Must be able to lift up to 10 pounds
• May require periods of travel

Additional Information

• Applications are expected to be accepted for at least three business days and may continue until a qualified applicant is selected or the position is cancelled.
• JE Dunn provides reasonable accommodations to qualified individuals with disabilities.
• JE Dunn Construction will not sponsor an applicant for work visa status or employment authorization, and will not offer immigration-related support for this position.

Benefits

The benefits package aligned to this position is Professional Non-Union.