mbzuai-oryx/Video-ChatGPT

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1506 stars · 128 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Video-ChatGPT is a video conversation model that combines large language models with a pretrained visual encoder adapted for spatiotemporal video representation, enabling detailed conversation about videos. It also ships a quantitative evaluation benchmarking framework (VCGBench) for assessing video-based conversational models.

Use cases

• chat with a model about a video's content
• generate detailed video descriptions and captions
• zero-shot video question answering
• benchmark video conversational models quantitatively
• build a multimodal video understanding assistant
• evaluate temporal understanding of video LLMs

When to choose

• you need a research-grade video-language conversation model
• you want a standardized benchmark for video chat models
• you need zero-shot video QA on datasets like MSVD, MSRVTT, TGIF, or ActivityNet

When to avoid

• you need production-ready, low-latency video analysis at scale
• you lack GPU resources for inference and training
• you only need image (not video) understanding

Facets

library · maturity active

machine-learning video-processing chatbot llm-inference benchmarking artificial-intelligence computer-vision large-language-models python multimodal vision-language-model video-understanding video-qa video-conversation evaluation-benchmark research video natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mbzuai-oryx/Video-ChatGPT")