OpenLIT
Apache-2.0 OTel tracing, evals and guardrails for agents
AI Agents / Agents · Apache-2.0 · 2.9k
Reviewed 2026-10-18 · last push 2026-10-15 · repo checked 2026-10-19
What's Good
Apache-2.0 (openlit/openlit), free to self-host. Integrations cover Claude Code, Codex, Cursor, the OpenAI Agents SDK, LangGraph, CrewAI and 70+ more, with OpenTelemetry-native output you can send to your own backend. Includes an OTel GPU collector for model-serving hardware. ★~2.9k.
The Catch
The README is heavy on the new agent-harness-engineering framing; underneath it is an OTel tracing and eval platform in a crowded field. Self-hosting means running its UI and ClickHouse. Many repos and releases (SDKs, collectors) to keep in sync.
Verdict
A solid self-hosted LLM observability option, especially if you also watch GPU cost.
Embed
Maintainer? Add the badge to your README. It is free, links to this review, and there is no paid version.
Markdown
[](https://stackgems.com/gems/openlit)
HTML
<a href="https://stackgems.com/gems/openlit"><img src="https://stackgems.com/badge/openlit.svg" alt="OpenLIT reviewed on Stack Gems" height="20"></a>
Related
AI Agents →- Arize PhoenixELv2 self-host AI observability & eval — traces, datasets, playground
- e2e (TesterArmy)Apache-2.0 agent-driven e2e tests for web and mobile — replays without model calls
- OpikApache-2.0 LLM and agent tracing, evaluation and monitoring by Comet
- LangWatchApache-2.0 LLM tracing, agent tests, evals, gateway
- HolmesGPTApache-2.0 CNCF AI agent for production incidents