ShareGPT4Omni/ShareGPT4Video resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1093 stars · 46 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ShareGPT4Video is the official implementation of a NeurIPS 2024 paper providing a large-scale video-text dataset (40K GPT4V-generated captions plus millions of model-generated ones), a general video captioner (ShareCaptioner-Video), and an 8B large video-language model. It also demonstrates improved text-to-video generation using its high-quality captions.

Use cases

• generate dense captions for videos
• train a video-language model for video understanding
• improve text-to-video generation with better captions
• caption videos of varying durations and resolutions
• build video question answering datasets

When to choose

• you need high-quality video captions for training multimodal models
• you want a strong open video-language model or captioner
• you need a large video-text dataset for research

When to avoid

• you need a production-ready product with support guarantees
• you lack GPU resources for large model inference or training
• you need a permissively licensed library - the repo has no license

Facets

dataset · maturity active

machine-learning nlp video-processing data-generation large-language-models computer-vision artificial-intelligence python video-captioning video-text-dataset multimodal text-to-video lvlm gpt4v neurips-2024 video natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ShareGPT4Omni/ShareGPT4Video")