Software Engineer

As a Software Engineer with Microsoft’s Foundry Inferencing & Training organization, you will help power large-scale AI training and inference workloads. The team focuses on building the infrastructure and developer tools that run across GPU clusters and Kubernetes, with deployments spanning Azure and partner clouds. This is a hands-on role for engineers who enjoy reliability work, production monitoring, and improving the end-to-end workload experience.

Location: Redmond, WA (onsite)

Compensation: USD 85,400 - 183,700 per year. The typical base pay range across the U.S. is USD $85,400 - $168,100 per year, with different location-specific ranges for the San Francisco Bay area and New York City metropolitan area (USD $111,100 - $183,700 per year). Certain roles may be eligible for benefits and other compensation. More details: https://careers.microsoft.com/us/en/us-corporate-pay.

What you’ll do

• Design, develop, test, and maintain services and tools that support large-scale AI training and inference workloads.
• Write reliable, maintainable code using languages such as Go, Rust, Python, C++, or C#.
• Contribute to infrastructure deployed across large-scale Kubernetes and GPU clusters in Azure and partner clouds.
• Collaborate with engineers and AI researchers to understand requirements, troubleshoot issues, and improve the workload experience.
• Monitor production systems, investigate reliability and performance issues, and implement fixes with guidance from experienced engineers.
• Participate in code reviews, design discussions, testing, deployment, and operational support.
• Apply engineering best practices and AI-assisted development tools to improve system quality, security, reliability, and efficiency.

What you bring

• Bachelor’s degree in Computer Science or a related technical field, and technical engineering experience coding in languages including (but not limited to) C, C++, C#, Java, JavaScript, Go, Rust, or Python.
• Or equivalent experience.

Helpful experience

• Experience with distributed systems, Kubernetes, containers, or cloud infrastructure.
• Experience developing software in Go, Rust, Python, C++, or C#.
• Familiarity with Linux, automated testing, CI/CD, monitoring, or production operations.
• Familiarity with AI/ML platforms, GPU infrastructure, large-scale training, or inference systems.
• Experience collaborating with others to deliver software and resolve technical issues.

Tech you’ll work with

• Go, Rust, Python, C++, C#, C, Java, JavaScript
• Kubernetes, Azure, Linux

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.