simonw/llm

Health v2 · maintenance only

Adoption not part of the score

12412 stars · 963 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A CLI tool and Python library for running prompts against large language models from OpenAI, Anthropic, Google, and many other providers, including locally installed models. It logs prompts and responses to SQLite, supports embeddings, structured extraction, tool execution, and is extensible via a plugin system.

Use cases

• run llm prompts from the terminal
• chat with gpt or claude from the command line
• query local models like gpt4all from cli
• store llm prompt history in sqlite
• generate text embeddings for a collection of documents
• extract structured from text with an llm
• script llm calls in python

When to choose

• you want a unified CLI over many LLM providers and local models
• you need logged, reproducible prompt/response history
• you want a scriptable Python API plus plugin extensibility

When to avoid

• you need a graphical chat interface
• you need fine-grained training or fine-tuning tooling
• you need a hosted service with team management

Facets

cli-tool · maturity stable

llm-inference cli rag plugin-system sdk large-language-models developer-tools artificial-intelligence cli python cross-platform windows openai anthropic gemini local-models embeddings sqlite-logging prompt-templates command-line macos linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="simonw/llm")