Traceloop
OpenLLMetry: the standard OpenTelemetry instrumentation for LLM apps, plus a managed platform.
About
Traceloop maintains OpenLLMetry (traceloop/openllmetry, Apache-2.0, ~7.5k stars) — the de-facto standard OpenTelemetry instrumentation for LLM libraries (one-line Traceloop.init() covers OpenAI, Anthropic, LangChain, and more). The managed Traceloop platform adds dashboards, prompt management, and evaluations on top.
If you want LLM traces in your existing observability stack (Datadog, Grafana, Honeycomb), OpenLLMetry is the path of least resistance. Issue count is high relative to stars — reflects broad usage surface.
What it can do
- One-line instrumentation for major LLM libraries
- OpenTelemetry-native spans
- Managed dashboards + prompt management
- Works with any OTEL backend
- Evaluations and monitoring
Setup
pip install traceloop-sdk.- Call
Traceloop.init()with your API key (or OTEL exporter config). - Run your app — spans flow to Traceloop or your own backend.
- Add prompt management and evals in the dashboard.
Prerequisites
Python or JS runtime; Traceloop API key or an OTEL backend.
Use cases
Works with
Trust score — 8/10
Scored 8/10 (verified tier). Apache-2.0, the standard OTel instrumentation for LLMs (~7.5k stars, 46 releases/12mo), official site live. Docked for a high issue count relative to stars. Verified tier on the strength of the open instrumentation standard + docs.
★ 7,486 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 7.4/10
- Maintenance · recency, releases, issue load
- 8.2/10
- Openness · license + docs
- 9.4/10
- Manual review · sanity read + red-flag check
- 8.0/10
- · 7,486 GitHub stars (log-scaled vs catalog peers)
- · last push 1d ago; 46 releases/12mo; 778 open issues
- · manual review: OpenLLMetry instrumentation is the standard OTel approach; high issue count vs stars; license: Apache-2.0
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.