shibing624/MedicalGPT

Health v2 · maintenance only

Adoption not part of the score

5748 stars · 790 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

MedicalGPT is a Python training framework for building medical-domain large language models using the full ChatGPT-style training pipeline: incremental pretraining, supervised finetuning, RLHF, DPO, ORPO, GRPO, and on-policy distillation. It supports LoRA and full-parameter training of models like Qwen and LLaMA with DeepSpeed, and includes medical data samples and model releases on Hugging Face.

Use cases

• train a medical domain LLM from a base model
• finetune an LLM with SFT on medical QA data
• align a chat model with RLHF or DPO
• run GRPO preference optimization training
• distill a large model into a smaller one with on-policy distillation
• finetune a model for tool calling / function call
• build a healthcare chatbot model

When to choose

• you want a complete, educational pretraining-to-alignment pipeline in one repo
• you need medical-domain LLM finetuning with ready sample datasets
• you want support for many alignment methods (DPO, ORPO, GRPO, OPD) in a single codebase

When to avoid

• you only need inference or a ready-made medical chatbot without training
• you need a production-grade multi-node training platform with heavy orchestration
• your domain is not medical and you prefer a more general finetuning framework

Facets

library · maturity active

llm-training machine-learning deep-learning rag chatbot large-language-models healthcare machine-learning python llm-finetuning rlhf dpo orpo grpo sft pretraining medical-ai huggingface lora natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="shibing624/MedicalGPT")