EngineerJobs.io
← Back to all jobs

Job Description

Tango is seeking a Senior Applied AI Engineer based in Oregon (onsite) to build and ship Tango’s first AI-powered product. The role focuses on converting generative AI and machine learning into dependable, production-ready capabilities across agent design, retrieval, evaluation, safety, and cross-functional delivery.

Responsibilities

  • Design, build, and ship production AI agents on LangGraph, keeping the agent layer portable across cloud platforms.
  • Own agents end to end, including graph design, tool definitions, prompt and context engineering, durable execution, failure and retry behavior, and cost and latency budgets.
  • Build agent tooling that integrates with internal systems using MCP, using direct API calls where they are a better fit, and enabling agent-to-agent interfaces as agents compose.
  • Deliver human-in-the-loop review flows, including interrupt points, confidence surfacing, and correction paths that allow customer review and override of agent output.
  • Build and tune retrieval, including chunking, hybrid retrieval, grounding, and citation back to the source page and paragraph.
  • Contribute agent evaluations through golden datasets, LLM-as-judge and deterministic scorers, and regression suites that run in CI based on the platform’s shared evaluation harness.
  • Diagnose quality failures to identify root causes such as retrieval misses, prompt defects, tool errors, model regressions, or flawed ground truth, then correct the relevant layer.
  • Own agent-level safety behavior, including prompt-injection resistance, PII handling, and refusal and escalation paths using the platform guardrail service maintained by Platform Engineering.
  • Partner with Product to translate accuracy thresholds, confidence disclosure, and human-in-the-loop trigger logic into shipped behavior.
  • Work with Platform Engineering on deployment, and with Data Platform on curated datasets agents rely on.
  • Feed curated agent session and usage analytics into the warehouse so agent performance can be measured alongside product analytics.
  • Transition reference agents to domain teams for long-term operation, and contribute to a shared agent quality standard.

Requirements

  • 7+ years of professional software engineering experience, including 2+ years building LLM-powered systems that reached production and real users.
  • Strong expertise in Python and its service stack (FastAPI, Pydantic, or equivalents), with testing, code review, CI/CD, and production ownership practices.
  • Production experience with an agent orchestration framework, with LangGraph strongly preferred; LangChain, OpenAI or Claude Agents SDKs, or equivalent frameworks are acceptable.
  • Hands-on depth with at least one frontier model API.
  • Hands-on LLM evaluation experience, including golden datasets, LLM-as-judge and deterministic scorers, regression testing, and using evaluation results to gate releases.
  • Experience with MCP tool servers or comparable tool and function-calling protocols, plus multi-agent patterns.
  • Production RAG and retrieval experience: chunking strategy, hybrid retrieval, grounding, citation, and diagnosing retrieval failures.
  • Experience with LLM observability and tracing (LangSmith, Langfuse, Arize, or equivalents), and with prompt and version management.
  • Sound judgment on failure modes such as hallucination, prompt injection, and silent degradation, including the ability to separate acceptable failures from unacceptable ones.

Technologies

  • Python, FastAPI, Pydantic
  • LangGraph, LangChain, OpenAI, Claude Agents SDKs
  • MCP, MCP tool servers
  • LangSmith, Langfuse, Arize
  • RAG, LLM-as-judge, vector and hybrid retrieval stores (pgvector, Pinecone, Weaviate, Qdrant)
  • CI/CD, Celery/Redis

Preferred

  • Graph-backed agent memory or knowledge graphs (Neo4j or similar).
  • Production vector and hybrid retrieval stores (pgvector, Pinecone, Weaviate, Qdrant).
  • Async task orchestration for long-running document pipelines (Celery/Redis or equivalent).
  • Document intelligence and information extraction at scale, including OCR, layout-aware parsing, and structured extraction from long documents.

Compensation and Benefits

  • Salary: USD 160,000 - 190,000 per year
  • Competitive Compensation
  • Comprehensive benefits: health, dental, and vision insurance
  • 401(k) plan with company match
  • Generous paid time off
  • Flexible work environment (remote, hybrid, or in-office)
  • Inclusive and collaborative culture

Similar Jobs