Data Engineer II

The Supportability & Customer-Centric Engagement and Engineering Direct (SUCCEED) team at Microsoft is hiring a Data Engineer II to build data products that support engineering, supportability, escalation, and operational intelligence.

Responsibilities

• Design, build, and maintain data pipelines, transformations, semantic models, and curated datasets across engineering and operational data sources.
• Collaborate with product management, engineering, support teams, and leadership stakeholders to define metrics, key business measures, and data quality expectations.
• Implement telemetry validation plus checks for data freshness, completeness, and reliability.
• Develop and maintain dashboards, scorecards, and operational reporting, including Microsoft reporting tools or equivalent reporting experience.
• Integrate data from sources including Azure DevOps, telemetry platforms, support and escalation systems, release-readiness sources, and business reporting tools.
• Automate manual reporting and intake workflows where feasible.
• Enhance discoverability, governance, dataset ownership, and documentation for critical datasets.
• Support release readiness, customer health, feature adoption, and supportability and escalation analytics.
• Investigate data issues and analyze anomalies using root-cause reporting; drive fixes with upstream and downstream partners.

Requirements

• Bachelor’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or a related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
• Master’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or a related field AND 1+ year experience in business analytics, data science, software development, data modeling, or data engineering.
• OR equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements for the role.
• Ability to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Technologies

• Python
• PySpark
• Kusto Query Language
• Azure Data Explorer
• Microsoft Fabric
• Azure Synapse Analytics
• Apache Spark

Preferred Qualifications

• Experience with Python and PySpark scripting for data transformation, automation, validation, or analytics workflows.
• Experience building ETL / ELT pipelines, scheduled data refreshes, production data workflows, or reporting data models.
• Experience with Kusto Query Language, Azure Data Explorer, Microsoft Fabric, Azure Synapse Analytics, Apache Spark, or similar big-data platforms.
• Experience with telemetry, observability, product usage, supportability, or reliability datasets.
• 4+ years of experience with large-scale data platforms, telemetry, business intelligence reporting, or operational analytics.
• Proven experience developing and deploying autonomous artificial intelligence agents or agentic automation systems that reason over data, operate reliably in production, and support continuous automated insight generation.

Pay

• Typical base pay range across the U.S. for this role: USD 102,100 - 202,200 per year.
• There is a different range for specific work locations within the San Francisco Bay area and New York City metropolitan area: USD 133,800 - 219,200 per year.
• Salary range listed for the posting: USD 102,100 - 219,200 per year.

Location

• Redmond, WA (onsite)