Applied AI Engineer

Build production agentic AI services that help resolve Azure customer issues faster while reducing avoidable support demand. This onsite role in Redmond, WA focuses on designing, shipping, and operating LLM-based solutions end to end, with an emphasis on secure deployment patterns and Responsible AI practices.

What you’ll do

• Translate product specifications into AI service architectures by decomposing business intent into agent workflows, data source integrations, and scalable service designs.
• Build agentic AI workflows using Azure AI Foundry Agent Service and the Microsoft Agent Framework, including multi-agent coordination, tool integrations, and agent lifecycle management.
• Develop and iterate on LLM solutions with prompt engineering, model selection, and cost/token optimization, including RAG pipeline design.
• Create evaluation systems to validate agent correctness and safety before production, including rubrics, golden datasets, and judge agents.
• Write production-quality C# and Python using test-driven development, helping ensure reliability, performance, and security standards are met.
• Deploy services using CI/CD pipelines, feature flags, and staged rollouts, backed by full production observability using tracing, logging, and metrics.
• Implement secure service patterns including RBAC, Managed Identities, and secrets management.
• Integrate agents with Azure data sources and cloud-native services to ground responses in real-time signals.
• Apply Responsible AI across agent development to support outputs that are safe, fair, and compliant.
• Deliver reliably within sprint and co-development commitments across ACES and partner engineering teams.
• Own the end-to-end lifecycle of AI service components, including design, development, testing, deployment, monitoring, and incident response.

Requirements

• Bachelor’s Degree in Computer Science or a related technical field AND 2+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements is required for this role.
• Required to pass the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Technologies you may work with

• C#, Python, C, C++, Java, JavaScript
• Azure AI Foundry Agent Service, Microsoft Agent Framework, LLM orchestration, multi-agent coordination
• RAG, prompt engineering, cost/token optimization, evaluation frameworks, golden datasets, judge agents, vector retrieval systems
• CI/CD pipelines, feature flags, tracing, logging, metrics
• RBAC, Managed Identities, secrets management
• Azure services including Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, Azure data sources, container orchestration, and microservices architecture
• Agent-to-agent communication protocols, Responsible AI

Preferred qualifications

• Master’s degree in Computer Science, AI, or related field.
• 4+ years of software engineering experience in C# and/or Python, including production deployment experience.
• Experience building or integrating with LLM-based systems (prompt engineering, RAG, or agent frameworks).
• Familiarity with Azure services such as Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar technologies.
• Experience with CI/CD pipelines, automated testing, and production observability.
• Strong understanding of data structures, algorithms, and system design fundamentals.
• Experience with multi-agent orchestration and agent-to-agent communication protocols.
• Experience with evaluation frameworks for AI systems (rubrics, golden datasets, judge agents).
• Familiarity with RAG pipelines and vector retrieval systems.
• Experience with container orchestration, microservices architecture, and cloud-native deployment patterns.
• Experience with security best practices (RBAC, Managed Identities, secrets management).
• Experience working in Agile/sprint-based delivery with cross-org dependencies.
• Strong problem-solving skills and ability to thrive in a fast-paced, collaborative environment.

Compensation: USD 102,100 - 219,200 per year. The typical base pay range across the U.S. for Software Engineering IC3 is USD $102,100 - $202,200 per year, with different ranges for the San Francisco Bay area and NYC metro: USD $133,800 - $219,200 per year.

Application window: This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.