# future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Repository: https://github.com/future-agi/future-agi
Canonical: https://ross.abutalabs.com/products/future-agi
Homepage: https://futureagi.com
Language: Python
License: Apache-2.0
License Family: permissive
Topics: ai-gateway, llm, observability, simulation, ai-agents, ai-evals, ai-simulations, evaluation-framework, llm-evaluation, llm-observability, llmops, opentelemetry, rag, rag-evaluation, tracing, guardrails, ai-optimization, hallucination-detection, telemetry, model-evaluation
Last push: 2026-08-26T20:20:53+00:00

## Health v2 (maintenance only)
Score: 81/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 99, release rhythm 99, longevity 9
- inputs: {"age_days": 132, "days_push": 7, "days_rel": 8, "gap_med": 1.0, "n_releases_24m": 25}
- flags: young
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1833, forks 548 (observed 2026-08-28T04:05:41.634534+00:00)

## What it is
Future AGI is an open-source, self-hostable platform for evaluating, observing, and improving LLM and AI agent applications, combining tracing, evaluations, simulations, datasets, a gateway, and guardrails in one feedback loop. It ships SDKs for Python, TypeScript, Java, and C#, a REST API, and integrates with 79+ frameworks like OpenAI, LangChain, and LlamaIndex.

## Use cases
- evaluate llm outputs for hallucinations
- trace ai agent calls in production
- run rag evaluation pipelines
- simulate ai agents at scale with synthetic data
- add guardrails to block prompt injection and pii leaks
- self-host an llm observability platform
- optimize prompts from evaluation feedback
- monitor llm app quality with dashboards and alerts

## When to choose
- you need end-to-end evals, tracing, and guardrails for LLM or agent apps in one self-hostable platform
- you want OpenTelemetry-compatible tracing across many LLM frameworks
- you need simulation and synthetic data to test agents before deployment

## When to avoid
- you need a battle-tested stable release - the repo is explicitly a nightly build with rough edges
- you only need simple logging without an evaluation or observability platform
- you require a lightweight library rather than a full platform with dashboard and services

## Facets
- artifact type: service
- maturity: experimental
- function: monitoring, tracing, testing, benchmarking, alerting, rag, llm-inference, agent-framework, sdk, api-framework
- domain: large-language-models, machine-learning, monitoring, developer-tools, self-hosted
- platform: python, self-hosted, cross-platform
- tags: llm-evaluation, llm-observability, llmops, guardrails, hallucination-detection, ai-gateway, prompt-optimization, simulation, opentelemetry, synthetic-data-generation, ai-agents, retrieval-augmented-generation, docker, web-server, nodejs

## Member repositories
- future-agi/future-agi (main) score 81

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:41.634534+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:18:38.122795+00:00, confidence not recorded.
  - readme: https://github.com/future-agi/future-agi (fetched 2026-08-28T04:05:41.634534+00:00, sha da9dbea5f350)
  - homepage: https://futureagi.com (fetched 2026-08-29T10:58:17.377288+00:00, sha 0d02c910cc59)
  - site_page: https://docs.futureagi.com (fetched 2026-08-29T10:58:17.382500+00:00, sha d3b99d64ecdc)
  - site_page: https://docs.futureagi.com/docs/api (fetched 2026-08-29T10:58:17.384411+00:00, sha b7baed9ab26b)
  - site_page: https://docs.futureagi.com/docs/sdk (fetched 2026-08-29T10:58:17.386366+00:00, sha d7499e41305d)
  - site_page: https://futureagi.com/changelog (fetched 2026-08-29T10:58:17.379934+00:00, sha 8fb2be986b6e)
  - site_page: https://futureagi.com/integrations (fetched 2026-08-29T10:58:17.388222+00:00, sha 7782a047fa14)
  - site_page: https://futureagi.com/pricing (fetched 2026-08-29T10:58:17.389816+00:00, sha fd34337537a2)
- Data as of 2026-08-30T08:39:29.467469+00:00.