Llm Platform Engineer Jobs

1 job found

Today

Data AI Engineer

RV Soft Chicago, IL

Chicago, IL

Today

$55 - $60/hr Full time Artificial Intelligence Data & Ai Data Engineer

Apply Now

Job Description

This hybrid role in Chicago focuses on LLM platform engineering and production data pipelines, with strong observability and regulated-enterprise delivery experience.

Key Responsibilities

Design, build, or operate an API gateway, reverse proxy, or multi-tenant platform.
Deliver LLM platform engineering capabilities, including:
- Streaming support and server-sent events
- Token accounting
- Prompt and response guardrails
- Model evaluation
Build and maintain Kafka and Snowflake data pipelines used for audit and consumption data.
Implement deep observability using:
- Prometheus and PromQL
- Grafana
- Loki
- OpenTelemetry
Use Redis or Valkey beyond basic caching, including:
- Counters
- TTL usage
- Distributed rate-limiter semantics
Work effectively in a regulated enterprise environment, including corporate proxies, private networking, and strict change control.

Required Experience

Data Engineering: 10 years (Required)
AI: 2 years (Required)
Kafka: 10 years (Required)
OpenTelemetry: 6 years (Required)

Technologies

API gateway
Reverse proxy
Multi-tenant platform
Server-sent events
Token accounting
Kafka
Snowflake
Prometheus
PromQL
Grafana
Loki
OpenTelemetry
Redis
Valkey

Compensation and Work Details

Pay: USD 55.00 - 60.00 per hour
Expected hours: 40.0 per week
Location: Hybrid remote in Chicago, IL 60616
Minimum experience: 2 years

View full job page →

Get Llm Platform Engineer Jobs alerts

New Llm Platform Engineer Jobs, daily.