hyperonym/basaran

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

1282 stars · 77 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Basaran is an open-source alternative to the OpenAI text completion API that serves Hugging Face Transformers-based text generation models behind a compatible streaming API. It ships as a Docker image with multi-GPU support, quantization, server-sent events, and a web-based playground.

Use cases

• self-host an OpenAI-compatible API for local LLMs
• serve hugging face transformer models with streaming completions
• replace OpenAI API with open-source model without changing client code
• deploy llama models behind a REST completion endpoint
• run text generation inference with multi-GPU and quantization
• expose server-sent events streaming for LLM generation

When to choose

• you already use OpenAI client libraries and want to swap in an open-source model
• you need a drop-in streaming completions API for Hugging Face models
• you want a simple Docker-based LLM serving solution with GPU support

When to avoid

• you need OpenAI chat endpoints or embeddings rather than text completions
• you need high-throughput production serving with continuous batching like vLLM
• you don't use Python or Hugging Face Transformers models

Facets

service · maturity active

llm-inference http-server api-framework streaming large-language-models apis self-hosted python self-hosted openai-api-compatible huggingface-transformers text-generation server-sent-events llm-serving natural-language-processing docker gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="hyperonym/basaran")