Enterprise Rag Engineer Jobs

1 job found

Today

Senior AI Engineer

Johnson Service Group Inc. Boston, MA

Boston, MA

Today

$55 - $70/hr Contract Agentic Ai Ai Agent Ai Agent Platform

Apply Now

Job Description

Johnson Service Group Inc. is seeking a Senior AI Engineer to design and scale enterprise AI capabilities, including agentic systems and retrieval augmented generation (RAG) solutions. This contract role is based in Boston, MA with a hybrid schedule (3 days per week) and focuses on building within the Microsoft Azure ecosystem.

Key Responsibilities

Build and scale Azure AI Foundry capabilities, including models, prompts, tools, orchestration, observability, and governance.
Develop agentic systems using LangChain and LangGraph, applying guardrails, retries, and policy-driven execution.
Deliver enterprise RAG solutions using Azure AI Search and Azure AI Embeddings.
Design automated ingestion pipelines and integrate enterprise knowledge sources.
Enable AI experiences across Azure Bot Service, Microsoft Teams, and Microsoft 365 Copilot.
Implement security and governance controls, including Responsible AI, PII filtering, prompt governance, RBAC, and Key Vault controls.
Drive CI/CD and DevOps practices for AI agents, prompts, skillsets, and indexes.
Lead and mentor engineers, collaborating with architecture, security, and compliance teams.

Required Qualifications

Strong Python development experience, including Poetry.
Experience with Azure OpenAI, Azure AI Services, and Azure AI Foundry.
Strong Azure AI Search experience, including hybrid, semantic, vector search, skillsets, and indexers.
Experience building agentic AI solutions using LangChain and LangGraph, including agent orchestration.
Enterprise RAG development experience and AI platform governance experience.
Experience with Azure Bot Service, Microsoft Teams, and Microsoft 365 Copilot.
Azure experience with Blob Storage, Logic Apps, Azure Functions, and Azure DevOps.

Additional Skills (Nice to Have)

ServiceNow Integration Hub experience.
Agent observability, evaluation, and trace tooling experience.
Experience operating AI systems at enterprise scale.

Technology Stack

Python, Poetry
Azure OpenAI, Azure AI Services, Azure AI Foundry
Azure AI Search, Azure AI Embeddings
LangChain, LangGraph
Azure Bot Service, Microsoft Teams, Microsoft 365 Copilot
Azure Blob Storage, Logic Apps, Azure Functions
Azure DevOps, Azure DevOps Wiki
Key Vault, SharePoint

Location, Schedule, and Contract Rate

Location: Boston, MA (hybrid)

Schedule: 3 days per week (hybrid)

Contract type: Contract

Rate range: USD 55–70 per hour, dependent on experience

The client has locations across continental US.

View full job page →

Get Enterprise Rag Engineer Jobs alerts

New Enterprise Rag Engineer Jobs, daily.