AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI observed · 2026-08-28
Health v2 · maintenance only
72/100
- Activity 89
- Release rhythm 45
- Longevity 79
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: 3.0
- age_days: 1114
- days_rel: 369
- days_push: 69
- n_releases_24m: 49
Adoption not part of the score
5797 stars · 615 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
AgentOps is a Python SDK and observability platform for monitoring, debugging, and evaluating AI agents and LLM applications. It auto-instruments LLM calls, tool usage, and multi-agent interactions, tracking traces, costs, and errors with integrations for frameworks like CrewAI, LangChain, AutoGen, and the OpenAI Agents SDK.
Use cases
- track llm costs per agent run
- debug ai agent workflows with session replay
- monitor ai agents in production
- evaluate and benchmark llm agents
- trace multi-agent interactions in crewai or langchain
- audit agent logs and errors
When to choose
- you build AI agents with frameworks like CrewAI, LangChain, AutoGen, or OpenAI Agents SDK and need observability
- you want LLM cost tracking and evaluation metrics with minimal code (two lines to init)
- you need session replay and time-travel debugging for agent runs
When to avoid
- you need general-purpose APM for non-LLM applications
- you want fully self-hosted observability without the AgentOps dashboard service
- you use a stack outside Python/TypeScript SDKs or unsupported LLM providers
Facets
library · maturity active
monitoring tracing benchmarking analytics logging sdk large-language-models developer-tools monitoring machine-learning python cross-platform llm-observability agent-monitoring cost-tracking llm-tracing agent-evaluation session-replay ai-agents nodejs
4 sources
- readme: https://github.com/AgentOps-AI/agentops · fetched 2026-08-28 · f797bb1a685d
- homepage: https://agentops.ai · fetched 2026-08-29 · cf2bd381c35b
- site_page: https://docs.agentops.ai · fetched 2026-08-29 · 1caf236089e3
- registry_pypi: https://pypi.org/pypi/agentops/json · fetched 2026-08-29 · 1738bb4701d6
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| AgentOps-AI/agentops | main | 72 |
For agents
markdown · JSON · MCP: product_card(name="AgentOps-AI/agentops")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem