EngineerJobs.io
← Back to all jobs

Job Description

Build Gen AI engineering standards at enterprise scale while leading delivery across multiple Royal Caribbean brands and business functions. This onsite role in Miami, FL blends hands-on agentic coding tool practice with platform-minded architecture, rigorous testing and evaluation, and mentoring across teams. You will help teams ship LLM applications with security guardrails, measurable quality, and an evolving delivery lifecycle tied to evidence.

What you’ll do

  • Set engineering standards for Gen AI across Royal Caribbean Group and lead multi-brand, multi-function project delivery
  • Join the GenAI Solutions Engineering team within AI & Analytics and collaborate closely with the GenAI Center of Excellence (CoE)
  • Work with business users to understand requirements, build rapid prototypes, and iterate based on feedback toward production-ready solutions
  • Act as a daily advanced user of agentic coding tools (Claude Code, GitHub Copilot, Cursor, and similar) and establish enterprise practices for context engineering, planning workflows, subagents, parallel sessions, hooks, and sandbox and permission settings
  • Design and maintain skills/plugins, slash commands, subagents, hooks, and MCP servers that encode standards and workflows, then distribute them through a versioned shared plugin catalog
  • Publish living, agent-readable guidance that is short, tested, and kept current as tools and models evolve
  • Define an AI-assisted delivery lifecycle that includes spec-driven development, small reviewable changes, automated AI-assisted code review, and clear human accountability for what ships, with security, data classification, and IP guardrails
  • Establish reference architectures, project templates, and reusable accelerators that start teams from a secure, tested, production-ready baseline
  • Measure impact of AI-assisted engineering (cycle time, rework, defect rates, token cost) and use evidence to refine tools, prompts, and practices
  • Define and operate Gen AI testing strategy across unit, integration, contract, end-to-end regression, and security testing for APIs, retrieval pipelines, agents, and tool integrations
  • Build test harnesses for non-deterministic behavior using mocked model/tool responses, recorded fixtures, and deterministic seams around LLM calls
  • Implement verification loops where agents check tests, type checks, linters, and evals before human review, and enforce CI/CD quality gates including secret scanning and evaluation checks
  • Lead blameless post-incident reviews and feed findings back into standards, skills, and tests
  • Own the enterprise evaluation framework for LLM applications and agents, including golden datasets, rubric- and model-graded evals, human review workflows, and metrics for groundedness, hallucination safety, latency, and cost
  • Integrate evals into CI/CD as release gates and into production as continuous monitoring with thresholds, dashboards, and regression alerts
  • Govern prompt and configuration changes through versioned, evidence-based evaluation before promotion
  • Mentor and coach engineers across teams, run hands-on enablement (workshops, demos, office hours), and contribute to AI governance principles and compliance alignment
  • Architect and develop Gen AI applications and agents using Azure AI Foundry, Azure Container Apps, Azure AI Search, and Azure Databricks

What you bring

  • 7+ years of professional software engineering experience
  • 2+ years building and shipping Gen AI or LLM-based applications to production
  • Bachelor’s degree in Computer Science Engineering or related field, or equivalent practical experience
  • Advanced daily hands-on proficiency with agentic coding tools (including context engineering instruction files, subagents/hooks, and parallel workflows) and the judgment to review and validate AI-generated code
  • Demonstrated experience building and distributing skills/plugins, slash commands, subagents, or MCP servers through a shared repository or catalog
  • Experience defining and driving engineering standards across multiple teams or products, including reusable templates and agent-readable guidance
  • Strong Python (required) and TypeScript or another full-stack language for API and architecture design and directing AI agents toward maintainable outcomes
  • Hands-on testing expertise including unit, integration, contract, and end-to-end testing (for example pytest), plus CI automation and approaches for non-deterministic components
  • Proven experience designing and operating LLM evaluation: golden datasets, metrics, LLM-as-judge, human review, release gating, and production monitoring
  • Deep understanding of Gen AI architectures: RAG, tool use, function calling, MCP, and single- and multi-agent orchestration
  • Proven Azure expertise including Azure AI Foundry, Container Apps, AI Search, APIM, Key Vault, Monitor, plus containerization and infrastructure as code
  • Experience with Azure DevOps or GitHub for CI/CD, release management, and environment promotion
  • Enterprise identity management and secure coding practices, including secure use of AI coding tools with enterprise data (Microsoft Entra ID, OAuth 2.0, service principals)
  • Experience with observability and LLMOps: tracing, prompt and model versioning, monitoring, and cost management
  • Track record partnering with business users to translate requirements into prototypes and cross-functional delivery, including mentoring other engineers
  • Excellent problem-solving and strong written and verbal communication to explain technical trade-offs and standards

Core technologies you’ll work with

Claude Code, GitHub Copilot, Cursor, CLAUDEmd, AGENTSmd, MCP servers, GitHub, Azure AI Foundry, Azure Container Apps, Azure AI Search, Azure Databricks, Python, FastAPI, Nextjs, PostgreSQL, Model Context Protocol (MCP), Microsoft Copilot Studio, Microsoft 365 Copilot, Microsoft Entra ID, MSAL, Azure Key Vault, Azure APIM, Azure DevOps, Azure Monitor, Log Analytics, OAuth 20, CI/CD, pytest, TypeScript

Preferred qualifications

  • Master’s degree in Computer Science Engineering, Data Science, or related field
  • Experience with the Claude Agent SDK or similar frameworks and running coding agents headlessly in CI/CD for review, testing, or automation
  • Experience operating an internal plugin or skills marketplace with versioning, testing, and adoption measurement
  • Experience with Databricks (Unity Catalog, Genie, MCP integrations) and enterprise semantic or data layers
  • Familiarity with Microsoft Copilot Studio, Microsoft 365 Copilot extensibility, and Semantic Kernel
  • Experience with evaluation and observability tooling for LLM applications and agents
  • Experience with multi-cloud Gen AI platforms (AWS Bedrock, Google Vertex AI)
  • Experience with MCP server design and agent-to-agent interoperability patterns
  • Experience with AI safety testing such as red teaming, prompt injection testing, and adversarial evaluation
  • Experience establishing or contributing to an AI governance or engineering community of practice in a large enterprise

Similar Jobs