Evaluation And Observability Engineer Jobs

1 job found

Today

Lead AI Engineer

Prologis Denver, CO

Denver, CO

Today

$147k - $202k/yr Full time Agentic Ai Agentic Ai Systems AI

Apply Now

Job Description

Prologis is building production-ready AI platform capabilities that help turn construction, procurement, and operations data into reusable, governed AI solutions. As the Lead AI Engineer, you will help design and deliver AI workflows and an AI-native building knowledge platform, coordinating closely with business, technology, security, and operations teams to move from prototype to pilot to production.

This onsite role is based in Denver, CO, where your work will connect models, assets, documents, telemetry, and operational context into structured knowledge that can support multiple building lifecycle use cases.

Responsibilities

Design and implement production AI platform capabilities, including agents, retrieval-augmented generation, tool calling, workflow orchestration, evaluation, and human review.
Build an AI-native building knowledge platform that links building models, assets, documents, telemetry, and operational context.
Develop multimodal data pipelines to convert BIM, Autodesk, geospatial, document, and operational data into structured, queryable knowledge.
Deliver AI workflows for design, construction, commissioning, building operations, sustainment, and reinvestment use cases.
Advance priority solutions from prototype through pilot and production using governance, documentation, evaluation, observability, and operational readiness.
Create reusable engineering patterns that help pilots scale into enterprise platform capabilities.
Partner with business, technology, security, and operations teams to define workflows, technical scope, implementation plans, rollout approaches, and post-launch improvements.

Requirements

6+ years of experience in software engineering, platform engineering, data engineering, applied AI, automation, technology consulting, or a related technical delivery role.
Experience designing, building, deploying, or maintaining AI-assisted workflows, large language model applications, or agentic systems for business use cases.
Experience converting ambiguous inputs such as workflows, spreadsheets, document repositories, project records, and stakeholder feedback into structured, testable, and governed solutions.
Experience leading discovery, workflow mapping, technical scoping, implementation, rollout, and post-launch iteration with users or domain teams.
Ability to apply context engineering, retrieval-augmented generation, semantic layers, tool or function calling, structured outputs, orchestration, evaluation, and human-in-the-loop design.
Programming or scripting capability in Python, TypeScript, JavaScript, or a comparable language.
Experience integrating APIs, SaaS platforms, data sources, workflow tools, and enterprise systems.
Ability to communicate technical decisions, risks, and outcomes clearly to both technical and non-technical stakeholders.

Technologies

Python, TypeScript, JavaScript
OpenAI Agents SDK, LangChain, LangGraph, LlamaIndex, MCP, AutoGen, CrewAI
n8n
Autodesk, AWS IoT, AWS Lambda
Data lakes, vector databases, Snowflake, knowledge graphs, ontologies, semantic layers

Benefits

Healthcare, dental, and vision insurance
401(k) retirement plan with a company match of 50% up to 12% of eligible compensation
Generous PTO with a starting accrual of 22 days a year in addition to paid holidays and volunteer time

Preferred

Experience with agent frameworks or orchestration patterns such as OpenAI Agents SDK, LangChain, LangGraph, LlamaIndex, MCP, AutoGen, CrewAI, n8n, or comparable platforms.
Experience with Autodesk construction and building platforms, BIM, geospatial systems, reality capture, simulation platforms, or digital twins.
Experience with AWS IoT, AWS Lambda, event-driven or serverless architectures, streaming telemetry, rules engines, or cloud-native operational data platforms.
Experience with building lifecycle systems, operational technology, building management systems, asset management, estimating, bid management, project controls, or field support.
Experience with data platform patterns such as knowledge graphs, entity resolution, ontologies, vector databases, Snowflake, data lakes, semantic layers, or BI and reporting.
Demonstrated willingness and capability to leverage emerging technology, automation, and AI tools to improve efficiency, quality, and speed, with sound judgment, creative thinking, and accountability for outcomes.

Compensation and Location

Salary range: USD 147,000 to 202,000 per year
Hiring salary range and whole compensation package (bonus target) determined by the candidate’s location, education, experience, knowledge, skills, abilities, internal equity, and alignment with market data
Employment type: Full time
Primary location: Denver, Colorado (onsite)
Additional locations: Chicago, Illinois; Dallas, Texas; Phoenix, Arizona; San Francisco, California

View full job page →

Get Evaluation And Observability Engineer Jobs alerts

New Evaluation And Observability Engineer Jobs, daily.