jd-opensource/JoyAI-Video-Edit

Health v2 · maintenance only

Flags: no_releases young

Adoption not part of the score

1671 stars · 74 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

JoyAI-Video-Edit is a real-time, instruction-guided video editing system that applies natural-language edits to live or uploaded video streams causally as frames arrive. It combines an MLLM condition encoder, causal video VAE, and a 16B-parameter multimodal diffusion transformer, reaching up to 30 FPS at 720p on high-end GPUs.

Use cases

• edit live camera streams with natural-language instructions in real time
• apply instruction-guided edits to uploaded videos without batch processing
• run reference-image-guided video-to-video editing preserving subject identity
• stream video editing at 720p on a single consumer GPU
• deploy low-latency streaming video-to-video generation services

When to choose

• you need real-time or streaming video editing rather than offline batch processing
• you want open-ended edits driven by natural-language instructions
• you have a modern NVIDIA GPU and need high-throughput 720p video-to-video editing

When to avoid

• you need precise frame-accurate non-generative video editing (use a traditional NLE)
• you lack a capable GPU or cannot host a 16B-parameter model
• you need lightweight CPU-only video processing

Facets

library · maturity active

video-processing machine-learning deep-learning llm-inference image-processing artificial-intelligence deep-learning media python video-editing diffusion-transformer autoregressive real-time instruction-guided streaming-video video-to-video ml video gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="jd-opensource/JoyAI-Video-Edit")