EngineerJobs.io
← Back to all jobs

Job Description

Build secure, production-ready AI services and agentic workflows in an onsite role in Charlotte.

  • Design and deliver production-grade AI applications, copilots, and agentic workflows tied to measurable business outcomes
  • Develop maintainable services using Python, exposing capabilities through secure, versioned FastAPI interfaces
  • Own end-to-end RAG pipelines including ingestion, chunking, metadata, embedding, retrieval, reranking, citations, and evaluation
  • Integrate LLMs via provider SDKs or model gateways, leveraging structured outputs, tool/function calling, retries, rate limits, token controls, and fallbacks
  • Orchestrate stateful workflows with LangGraph, using LangChain selectively for model, tool, retriever, and prompt integration
  • Apply Model Context Protocol (MCP) with hands-on understanding, including building or integrating MCP servers and MCP clients
  • Expose enterprise capabilities via MCP through tools, resources, and prompts using appropriate schemas and controls
  • Operate data pipelines by creating and running Apache Airflow DAGs for scheduled ingestion, embedding refresh, evaluation, batch processing, and data quality controls
  • Model application data in MongoDB including document models, indexes, and access patterns for application state, conversation history, metadata, and operational records
  • Strengthen reliability through automated testing, CI/CD, infrastructure configuration, logging, tracing, monitoring, and incident-ready runbooks
  • Collaborate across teams with product owners, data engineers, security, architecture, and subject-matter experts to translate requirements into safe technical designs
  • Document key engineering decisions covering architecture decisions, model limitations, data lineage, controls, and support procedures

Requirements

  • Typically 4+ years of software, data, or machine-learning engineering experience, including at least 1 year delivering LLM-enabled applications (equivalent depth accepted via shipped products)
  • Production ownership of at least one AI solution beyond proof of concept, with evidence such as monitoring, security controls, evaluation, support, and measurable outcomes
  • Bachelor’s degree in computer science, engineering, mathematics, or related discipline, or equivalent professional experience
  • Senior-level option: evidence of technical design leadership, mentoring, architecture decisions, and cross-team delivery
  • Experience with model gateways and providers such as Azure OpenAI, Anthropic, or AWS Bedrock
  • Experience with vector-search platforms/extensions such as MongoDB Vector Search, Elasticsearch/OpenSearch, or Milvus
  • MLOps/LLMOps tooling for prompt/version management, experiment tracking, evaluation, and tracing (example: Galileo)
  • Cloud-native delivery using RedHat OpenShift or equivalent infrastructure as code
  • Knowledge or experience with knowledge-graph, multimodal, fine-tuning, synthetic-data, or advanced agent evaluation
  • Experience in regulated or control-focused environments with formal architecture, risk, privacy, and change-management processes
  • Essential technical skills: Python, FastAPI & APIs, Apache, RAG, LLM, LangGraph, LangChain, MongoDB

Core technologies

  • Python
  • FastAPI
  • Apache Airflow
  • Apache
  • RAG
  • LLM APIs
  • LangGraph
  • LangChain
  • MongoDB
  • Model Context Protocol (MCP)
  • Azure OpenAI
  • Anthropic
  • AWS Bedrock
  • MongoDB Vector Search
  • Elasticsearch
  • OpenSearch
  • Milvus
  • Galileo
  • RedHat OpenShift
  • MCP servers
  • MCP clients

Similar Jobs