AI Engineer II
Job Description
Free Market Health is hiring an AI Engineer II (Embedded AI) in Pittsburgh, PA (onsite) to independently design, build, deploy, and continuously improve AI-enabled solutions.
Responsibilities
- Develop a strong understanding of assigned business area workflows, systems, data, priorities, and operational challenges
- Build trusted relationships with business users and stakeholders
- Identify opportunities for AI, automation, and process improvement
- Maintain and prioritize a pipeline of opportunities using business value, feasibility, adoption, and risk
- Translate moderately ambiguous business problems into practical, appropriately scoped technical solutions
- Drive solutions through implementation, user adoption, measurement, and continuous improvement
- Define and track outcomes including time saved, quality improvements, cost reductions, adoption, and operational impact
- Independently design, build, test, deploy, and support production AI agents, applications, automations, and supporting services
- Create agentic workflows that connect models, tools, enterprise data, APIs, and business applications
- Build secure integrations using REST APIs, Model Context Protocol, and appropriate authentication and authorization methods
- Implement and optimize LLM application patterns such as tool calling, structured outputs, retrieval-augmented generation, grounding, context management, and multi-step orchestration
- Design retrieval solutions using structured and unstructured data, embeddings, vector search, and enterprise knowledge sources
- Establish evaluation methods, testing standards, quality thresholds, observability, and failure-handling processes
- Monitor production solutions for reliability, accuracy, usage, adoption, performance, and cost
- Apply security, access controls, human oversight, and responsible AI governance across the solution lifecycle
- Assess whether AI is appropriate, and recognize cases where conventional software, deterministic automation, data engineering, or process improvement is a better fit
- Contribute reusable architectures, components, engineering patterns, and technical documentation
- Provide code reviews and informal technical guidance to earlier-career AI engineers
Requirements
- At least 3 years of experience building and delivering software, automation, integrations, or production AI-enabled applications
- Experience independently owning technical work from requirements or problem definition through implementation and production support
- Demonstrated success troubleshooting, maintaining, and improving production systems
- Strong Python skills and working proficiency in SQL
- Experience working with Databricks
- Experience developing solutions on a major public cloud platform
- Azure experience preferred
- Hands-on experience building and deploying LLM-powered applications or agentic systems
- Experience with modern AI-assisted development environments such as Cursor or Claude Code
- Working knowledge of prompting, tool calling, RAG, structured outputs, agentic workflows, evaluation, and observability
- Experience integrating enterprise systems via REST APIs and modern authentication methods
- Familiarity with Model Context Protocol and emerging agent interoperability approaches
- Strong software engineering practices: source control, testing, code review, documentation, CI/CD, and production support
- Ability to work independently with business users and stakeholders to understand operational challenges
- Ability to turn moderately ambiguous business needs into practical technical approaches
- Sound judgment on when AI is and is not the right solution
- Ability to balance rapid delivery with reliability, security, maintainability, and governance
- Ability to provide constructive technical feedback and guidance to less-experienced engineers
Technologies
- Python, SQL, Databricks
- Azure
- REST APIs, Model Context Protocol
- LLM application patterns, tool calling, structured outputs, retrieval-augmented generation, grounding, context management, multi-step orchestration
- Embeddings, vector search
- Cursor, Claude Code
- CI/CD
- LangGraph, LangChain
- Azure AI Foundry
- LLMOps
Benefits
- Unlimited PTO
- 100% employer-paid individual medical, dental, and vision premiums
- Employer HSA contribution
- Paid parental leave
- 401(k) match
- Transportation and parking benefits
- Flexible, collaborative work environment
Nice to Have
- Experience with Azure AI Foundry
- Production experience using LangGraph, LangChain, or comparable frameworks
- Experience developing or integrating Model Context Protocol servers
- Experience with agent evaluation, tracing, observability, or LLMOps
- Experience building enterprise RAG solutions using embeddings and vector search
- Experience implementing secure agent architectures with controlled tool access and appropriate human oversight
- Experience working with healthcare information, protected health information, or other regulated and sensitive data