# rustformers/llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Repository: https://github.com/rustformers/llm
Canonical: https://ross.abutalabs.com/products/rustformers-llm
Homepage: https://docs.rs/llm/latest/llm/
Language: Rust
License: Apache-2.0
License Family: permissive
Topics: ai, ggml, llm, ml, rust
Archived: true
Last push: 2024-06-24T16:29:01+00:00

## Health v2 (maintenance only)
Score: 10/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 0, release rhythm 8, longevity 90
- inputs: {"age_days": 1269, "days_push": 800, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: archived
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 6152, forks 382 (observed 2026-08-28T04:09:36.645851+00:00)

## What it is
An ecosystem of Rust libraries built on GGML for running large language model inference locally, including a CLI binary and reusable crates. The repository has been archived and is explicitly unmaintained, with the README recommending active alternatives such as mistral.rs, Candle, and llama.cpp bindings.

## Use cases
- run llm models locally in rust
- infer quantized ggml models from a rust program
- embed a local language model in an application
- chat with a local llm from the command line
- load ggml model weights in rust

## When to choose
- you need a frozen, historical reference implementation of GGML-based inference in Rust
- you are maintaining legacy code that already depends on this crate

## When to avoid
- you want actively maintained Rust LLM inference - use mistral.rs, Candle, or llama.cpp bindings instead
- you need support for recent model architectures released after mid-2024
- you are starting a new project and want community support or bug fixes

## Facets
- artifact type: library
- maturity: abandoned
- function: llm-inference, machine-learning, cli
- domain: large-language-models, machine-learning, developer-tools
- platform: rust, cross-platform, cli
- tags: ggml, quantized-models, archived, local-inference

## Member repositories
- rustformers/llm (main) score 10

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:09:36.645851+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T17:47:31.572305+00:00, confidence not recorded.
  - readme: https://github.com/rustformers/llm (fetched 2026-08-28T04:09:36.645851+00:00, sha ca714862c806)
  - homepage: https://docs.rs/llm/latest/llm/ (fetched 2026-08-29T08:44:26.842957+00:00, sha aae2151760c2)
  - site_page: https://docs.rs/ (fetched 2026-08-29T08:44:26.852188+00:00, sha 0867b88bcf6e)
  - site_page: https://docs.rs/crate/llm/latest (fetched 2026-08-29T08:44:26.854340+00:00, sha 9af850563ed5)
  - site_page: https://docs.rs/crate/llm/latest/features (fetched 2026-08-29T08:44:26.856691+00:00, sha 3db233b9943b)
  - site_page: https://docs.rs/about (fetched 2026-08-29T08:44:26.858474+00:00, sha 29ab7986fbf5)
  - site_page: https://docs.rs/about/badges (fetched 2026-08-29T08:44:26.860247+00:00, sha 6588cac258af)
  - site_page: https://docs.rs/about/builds (fetched 2026-08-29T08:44:26.862094+00:00, sha 811231ca4680)
  - site_page: https://docs.rs/about/metadata (fetched 2026-08-29T08:44:26.863714+00:00, sha 0dcdccb2b2b2)
  - site_page: https://docs.rs/about/redirections (fetched 2026-08-29T08:44:26.865180+00:00, sha 1b1efd93105f)
- Data as of 2026-08-30T08:39:29.467469+00:00.