Data AI Engineer

This hybrid role in Chicago focuses on LLM platform engineering and production data pipelines, with strong observability and regulated-enterprise delivery experience.

Key Responsibilities

• Design, build, or operate an API gateway, reverse proxy, or multi-tenant platform.
• Deliver LLM platform engineering capabilities, including:
  • Streaming support and server-sent events
  • Token accounting
  • Prompt and response guardrails
  • Model evaluation
• Build and maintain Kafka and Snowflake data pipelines used for audit and consumption data.
• Implement deep observability using:
  • Prometheus and PromQL
  • Grafana
  • Loki
  • OpenTelemetry
• Use Redis or Valkey beyond basic caching, including:
  • Counters
  • TTL usage
  • Distributed rate-limiter semantics
• Work effectively in a regulated enterprise environment, including corporate proxies, private networking, and strict change control.

Required Experience

• Data Engineering: 10 years (Required)
• AI: 2 years (Required)
• Kafka: 10 years (Required)
• OpenTelemetry: 6 years (Required)

Technologies

• API gateway
• Reverse proxy
• Multi-tenant platform
• Server-sent events
• Token accounting
• Kafka
• Snowflake
• Prometheus
• PromQL
• Grafana
• Loki
• OpenTelemetry
• Redis
• Valkey

Compensation and Work Details

• Pay: USD 55.00 - 60.00 per hour
• Expected hours: 40.0 per week
• Location: Hybrid remote in Chicago, IL 60616
• Minimum experience: 2 years