Jittor/JittorLLMs

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2413 stars · 187 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

JittorLLMs is a large language model inference library built on the Jittor deep learning framework, supporting models like ChatGLM, LLaMA/LLaMA2, ChatRWKV, PanGu, MOSS, and Atom7B. It dramatically lowers hardware requirements—running LLMs on machines with as little as 2GB RAM and no GPU—while offering fast loading via zero-copy technology and cross-platform portability.

Use cases

• run a large language model locally without a GPU
• deploy ChatGLM or LLaMA on a low-memory laptop
• serve an LLM behind a REST API
• chat with Chinese LLMs like ChatGLM and PanGu in a browser
• migrate LLM inference across heterogeneous hardware without code changes
• demo an LLM with a gradio web interface

When to choose

• you have limited RAM or no GPU and want local LLM inference
• you need good Chinese-language model support
• you want a one-command CLI, web, or API deployment of multiple open LLMs
• you need portable inference across different compute devices

When to avoid

• you need the broadest model ecosystem or fastest GPU throughput of mainstream frameworks like vLLM or llama.cpp
• you require production-grade scaling or multi-GPU serving
• you need fine-tuning or training features rather than inference

Facets

library · maturity active

llm-inference chatbot machine-learning cli http-server large-language-models artificial-intelligence chatbots windows python cli low-resource-inference cpu-inference chatglm llama chatrwkv pangu jittor chinese-llm gradio-web-demo natural-language-processing linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Jittor/JittorLLMs")