ogx-ai/ogx

Health v2 · maintenance only

Adoption not part of the score

8416 stars · 1363 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

OGX (formerly Llama Stack) is an open-source, OpenAI-compatible agentic API server and Python library that bundles inference, vector stores, file storage, moderation, tool calling, and agent orchestration into one process. It works with any model provider (Ollama, vLLM, Bedrock, Azure, etc.) and can be deployed as an HTTP server or imported as a library.

Use cases

• self-host an OpenAI-compatible API server for local models
• swap between LLM providers without changing application code
• build AI agents with tool calling and vector store search
• point Claude Code or Codex at alternative model backends
• run a drop-in replacement for the OpenAI API on my own infrastructure
• add moderation and file storage to an AI app without sidecar services

When to choose

• you want an OpenAI-compatible server you fully control and can run anywhere
• you need inference, vector stores, moderation, and agent orchestration in a single process
• you want model-agnostic routing across providers like Ollama, vLLM, Bedrock, or Azure
• you prefer a Python library option instead of running a separate gateway

When to avoid

• you only need a lightweight inference proxy or load balancer rather than a full stack
• you are locked into a single vendor's managed API and don't need portability
• you need a specialized high-throughput inference engine rather than an API layer over providers
• your stack is non-Python and you only want the library mode rather than the server

Facets

framework · maturity active

llm-inference agent-framework rag api-framework http-server vector-database chatbot sdk large-language-models apis self-hosted developer-tools python self-hosted cross-platform cli openai-compatible llama-stack api-server pluggable-providers model-agnostic tool-calling moderation vector-stores ai-agents retrieval-augmented-generation docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ogx-ai/ogx")