EngineerJobs.io
← Back to all jobs

Job Description

Senior Software Engineer II at RELX in Oklahoma City, OK focuses on building and operating production AI systems end to end.

Responsibilities

  • Design, build, and deploy production AI systems, including agentic workflows, RAG services, and structured extraction pipelines across multiple business units
  • Collaborate with business stakeholders and technical team members to scope AI use cases, define success metrics, and finalize requirements
  • Create and review detailed technical specifications and architecture documents for complex AI components
  • Build and maintain evaluation harnesses, establishing accuracy, latency, and cost baselines and monitoring results in production
  • Apply responsible AI practices: data handling, PII controls, hallucination mitigation, auditability, and human review where required
  • Own cost and performance of LLM workloads, including model selection, caching, and usage attribution
  • Implement and maintain CI/CD and deployment automation for AI services across AWS and Azure
  • Develop in an Agile environment, partnering with engineering, product, and business functions
  • Mentor less-senior engineers on AI system design, evaluation methodology, and production readiness

Requirements

  • 5+ years of software engineering experience
  • 2+ years building and shipping LLM-based or ML-based systems to production
  • BS in Engineering/Computer Science or equivalent experience
  • Proven ability to own an AI feature or service end to end: design, evaluation, deployment, and monitoring
  • Expert proficiency in TypeScript/Node.js and/or Python; C#/.NET knowledge is a plus
  • Hands-on experience with LLM platforms and APIs (including Azure OpenAI or equivalent), covering prompt design, tool/function calling, structured outputs, and model selection tradeoffs
  • Experience building RAG pipelines: chunking, embedding, hybrid retrieval, reranking, and grounding/citation
  • Strong understanding of schema-driven structured extraction from unstructured data, including Zod, Pydantic, and JSON Schema
  • Experience with AI evaluation frameworks: golden datasets, LLM-as-judge, precision/recall on extraction tasks, regression testing for prompts and agents
  • Strong SQL skills and experience with relational and vector data storage (SQL Server, PostgreSQL, Elasticsearch/vector stores)
  • Working experience with AWS and Azure: compute, storage, networking, IAM, and managed AI services; containerized deployment (Docker, Kubernetes or equivalent), secrets management, and observability (token usage, latency, cost attribution)
  • Knowledge of software development best practices, including test-driven development and code review

Technologies

  • TypeScript, Node.js, Python, C#/.NET
  • Azure OpenAI; LLM platforms and APIs; prompt design
  • Tool/function calling; structured outputs; model selection tradeoffs
  • RAG pipelines; Zod, Pydantic, JSON Schema
  • SQL, SQL Server, PostgreSQL, Elasticsearch; vector stores
  • AWS, Azure; Docker, Kubernetes
  • CI/CD; IAM
  • Grounding/citation; LLM-as-judge

Benefits

  • Comprehensive multi-carrier medical, dental and vision benefits
  • 401(k) with match and an Employee Share Purchase Plan
  • Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
  • Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
  • Family benefits including bonding and family care leaves, adoption and surrogacy benefits
  • Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
  • Annual Paid Time Off, up to two days of paid leave for Employee Resource Group participation and volunteering
  • Annual incentive bonus

About the Role

  • Performs complex research, design, and software development for production AI systems, including agentic workflows, LLM-powered pipelines, retrieval-augmented generation (RAG), and structured extraction services
  • Provides input to project plans, schedules, and methodology for cross-functional AI products
  • Leads system design across multiple systems and data sources
  • Mentors more-junior team members and collaborates with business stakeholders to convert ambiguous, unstructured problems into measurable AI solutions

Location: Oklahoma City, OK (onsite) · Salary: USD 95,300 - 158,800 per year · Minimum Experience: 5 years

Similar Jobs