ml-explore/mlx-lm

Health v2 · maintenance only

Adoption not part of the score

6801 stars · 996 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A Python package for running and fine-tuning large language models on Apple silicon using the MLX framework. It integrates with the Hugging Face Hub for model loading, quantization, and uploading, and provides both CLI tools and a Python API for text generation, chat, and LoRA/full fine-tuning.

Use cases

• run llms locally on mac
• generate text with a local llm on apple silicon
• fine-tune an llm with lora on a mac
• quantize a hugging face model to 4-bit
• chat with a local language model in the terminal
• convert and upload models to the hugging face hub
• run distributed llm inference on apple silicon

When to choose

• you want to run or fine-tune LLMs on Apple silicon (M-series) hardware
• you want easy access to thousands of Hugging Face models with quantization support
• you need both CLI tools and a Python API for LLM inference

When to avoid

• you are on Linux, Windows, or CUDA GPUs - use llama.cpp, vLLM, or transformers instead
• you need production-grade multi-GPU serving rather than local Apple silicon inference

Facets

library · maturity active

llm-inference llm-training cli sdk large-language-models machine-learning developer-tools python cli apple-silicon mlx hugging-face fine-tuning lora quantization text-generation macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ml-explore/mlx-lm")