gotzmann/llama.go

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

1397 stars · 73 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A pure-Go reimplementation of llama.cpp-style LLM inference, running LLaMA-family models on CPU without C++ dependencies. It includes tensor math, model loading, multi-threading, and an embedded REST API server mode.

Use cases

• run llama models in go
• local llm inference without python
• serve llama models via rest api in golang
• run gpt4all or vicuna models on cpu
• embed llm inference in a go application
• homelab llm inference without gpu cluster

When to choose

• you want LLM inference entirely in Go with no C/C++ toolchain
• you need to embed LLaMA-style model inference into Go services
• you run inference on CPU across Mac, Linux, or Windows

When to avoid

• you need the latest model formats like GGUF v3 or LLaMA 2 70B support
• you need GPU/CUDA acceleration
• you want an actively developed project - the author has moved to FastTensors and Booster

Facets

library · maturity maintenance

llm-inference machine-learning deep-learning large-language-models machine-learning deep-learning go windows cross-platform llama ggml pure-go inference cpu-inference quantization chatbot linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="gotzmann/llama.go")