LLaVA-VL/LLaVA-NeXT

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

4716 stars · 472 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

LLaVA-NeXT is a collection of open large multimodal models (LLaVA-NeXT, LLaVA-Video, LLaVA-OneVision, LLaVA-Critic-R1) that combine vision encoders with language models for image, video, and interleaved multimodal understanding. The repository provides model checkpoints, inference code, and a legacy training pipeline, with newer training moved to the lmms-engine project.

Use cases

• run a vision-language model on images and videos
• train or fine-tune a multimodal LLM
• build an image and video question-answering chatbot
• evaluate open multimodal models
• process interleaved image-text inputs with an LLM
• download open VLM checkpoints for research

When to choose

• you need open-weight multimodal models for image, video, or interleaved understanding
• you want to fine-tune or study LLaVA-family VLMs
• you need a strong open 7B-scale VLM with critic/reasoning variants

When to avoid

• you need the latest training pipeline - use lmms-engine instead, as this repo's training code is legacy
• you only need closed-source frontier multimodal APIs
• you need production inference serving rather than research code

Facets

library · maturity maintenance

machine-learning deep-learning llm-training image-processing video-processing large-language-models computer-vision deep-learning artificial-intelligence python multimodal vision-language-model vlm llava model-training open-source-models gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="LLaVA-VL/LLaVA-NeXT")