RanFeng/clipsketch-ai

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

1840 stars · 241 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ClipSketch AI is a web-based AI content creation workbench that imports videos from Bilibili and Xiaohongshu links, lets users frame-accurately tag highlight moments, and uses Google Gemini multimodal models to turn those moments into hand-drawn storyboards plus social media copy and covers. It is built with React 19, TypeScript, and Tailwind CSS, and can be run via Node.js or Docker.

Use cases

• turn video clips into hand-drawn storyboard images
• generate xiaohongshu-style social media captions from video frames
• tag highlight moments in a bilibili video frame by frame
• create video covers with AI
• merge a custom character avatar into generated storyboard scenes
• export tagged frames as a zip of images

When to choose

• you create derivative content from Bilibili or Xiaohongshu videos and want AI storyboards and captions
• you need millisecond-precise frame tagging with keyboard shortcuts
• you want a self-hosted, Docker-deployable creative tool powered by Gemini

When to avoid

• you need to process videos from platforms other than Bilibili or Xiaohongshu
• you don't have a Google Gemini API key or want a fully offline tool
• you need a license-clarified production deployment (the repo has no license)

Facets

application · maturity active

web-framework image-processing llm-inference prompt-engineering video-processing web-scraping artificial-intelligence large-language-models image-processing social-media web-development cross-platform storyboard gemini bilibili xiaohongshu social-media-copywriting frame-tagging react content-creation video nodejs web-server docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="RanFeng/clipsketch-ai")