modelscope/ms-swift

Health v2 · maintenance only

Adoption not part of the score

15809 stars · 1729 forks observed · 2026-10-11

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

ms-swift is a ModelScope community framework for fine-tuning, inference, evaluation, quantization, and deployment of 600+ text LLMs and 400+ multimodal LLMs. It supports PEFT (LoRA) and full-parameter training, Megatron parallelism, and RLHF algorithms like GRPO, DPO, and PPO.

Use cases

• fine-tune qwen or llama with lora
• run sft training on a large language model
• train a multimodal vision-language model
• do grpo reinforcement learning for llm
• merge and quantize a fine-tuned model
• deploy a fine-tuned llm for inference
• train embedding or reranker models
• dpo alignment training for chat models

When to choose

• you need a single framework covering CPT, SFT, DPO/GRPO, inference, evaluation, quantization, and deployment
• you want LoRA/PEFT or Megatron-based full-parameter training for many model families
• you work with multimodal LLMs like Qwen-VL or InternVL
• you need multi-hardware support including Ascend NPU and AMD GPUs

When to avoid

• you only need simple model inference without training
• you want a minimal single-model training script rather than a full framework
• you are not working with transformer-based LLMs or MLLMs

Facets

framework · maturity active

llm-training llm-inference rag machine-learning cli sdk large-language-models machine-learning deep-learning developer-tools python cli peft lora sft grpo rlhf megatron multimodal-llm modelscope quantization dpo fine-tuning qwen deepseek natural-language-processing linux gpu docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="modelscope/ms-swift")