janhq/cortex.cpp

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

2752 stars · 173 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Cortex.cpp is a C++ local AI platform that runs GGUF (llama.cpp) and ONNX models on your own machine, exposing an OpenAI-compatible HTTP API plus a CLI for pulling and running models. The repository has been archived and development has moved to menloresearch/llama.cpp.

Use cases

• run local llm with openai-compatible api
• self-host chat completions endpoint on my machine
• download and run gguf models from huggingface via cli
• replace openai api with local inference server
• serve llama models offline for private apps
• manage local model downloads and running processes

When to choose

• you need an OpenAI-compatible local inference server and are fine pinning an older release
• you want a simple CLI to pull and run GGUF/ONNX models locally

When to avoid

• you want active maintenance or new features - the repo is archived and development moved to menloresearch/llama.cpp
• you need a polished desktop chat UI - use Jan instead
• you need multi-GPU or production-scale serving - consider vLLM or llama.cpp directly

Facets

service · maturity abandoned

llm-inference http-server cli api-framework large-language-models artificial-intelligence self-hosted developer-tools windows cli self-hosted cpp gguf llamacpp onnx openai-compatible-api local-llm archived macos linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="janhq/cortex.cpp")