togethercomputer/OpenChatKit

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

8984 stars · 998 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

OpenChatKit is an open-source toolkit from Together, LAION, and Ontocord.ai for building and fine-tuning chat language models, including instruction-tuned models like GPT-NeoXT-Chat-Base-20B and Pythia-Chat-Base-7B. It bundles training code, inference tooling, a moderation model, and an experimental retrieval-augmented generation system.

Use cases

• train a custom open-source chatbot model
• fine-tune llama-2 for long context conversations
• run local inference with an instruction-tuned chat model
• add retrieval from custom documents to a chat model
• reproduce the pythia chat base 7b training
• add content moderation to a chatbot

When to choose

• you want to train or fine-tune your own open chat model
• you need an Apache-2.0 licensed chatbot base without API dependencies
• you want to experiment with retrieval-augmented chat models

When to avoid

• you just want to call a hosted LLM API without training
• you lack GPU resources for 7B-20B parameter models
• you need a production-ready, actively developed chat framework

Facets

framework · maturity maintenance

llm-training llm-inference rag chatbot machine-learning large-language-models artificial-intelligence chatbots deep-learning python cli chat-models instruction-tuning moderation-model retrieval-augmentation hugging-face open-source-models retrieval-augmented-generation gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="togethercomputer/OpenChatKit")