Opik

Health v2 · maintenance only

Adoption not part of the score

22726 stars · 1874 forks observed · 2026-10-19

What it is AI-extracted, prompt v1, taxonomy v1, 2026-10-12, confidence 0.97

Opik is an open‑source platform for LLM observability, evaluation and agent tracing. It provides dashboards, automated metrics and a conversational assistant to debug and improve AI workflows.

Use cases

• Log and visualize LLM calls and RAG pipeline steps
• Run automated evaluations of prompts and model outputs
• Debug multi‑step AI agents with trace‑based diagnostics
• Monitor token usage and cost across LLM applications
• Compare performance of different prompt versions in production

When to choose

• You need end‑to‑end tracing and evaluation for LLM or RAG systems
• You prefer a self‑hosted solution with full control over data
• Your workflow includes multi‑step agents that require debugging assistance

When to avoid

• You only need simple logging without a full observability stack
• You require a managed SaaS service with no infrastructure overhead
• Your stack is not compatible with Python or Docker/Kubernetes deployments

Facets

application · maturity active

monitoring logging artificial-intelligence large-language-models chatbots python cli llm-observability rag agent-tracing self-hosted open-source evaluation retrieval-augmented-generation docker kubernetes web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="comet-ml/opik")