chenfei-wu/TaskMatrix

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

34003 stars · 3200 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

TaskMatrix (Visual ChatGPT) is a Python framework that connects ChatGPT with a suite of visual foundation models like Stable Diffusion, GroundingDINO, and Segment Anything, enabling sending and receiving images during chat. It acts as a general interface where the LLM orchestrates multiple vision models to talk, draw, and edit images.

Use cases

• chat with an AI that can generate and edit images
• segment or detect objects in an image via natural language
• extend or outpaint an image to a larger size
• build a multimodal chatbot combining LLMs with vision models
• chain multiple foundation models to solve complex visual tasks
• caption images and answer visual questions in a conversation

When to choose

• you want an LLM-orchestrated pipeline of visual foundation models without training
• you need image generation, editing, detection, and segmentation inside a chat interface
• you want to extend the tooling with custom model templates

When to avoid

• you need a lightweight production-ready multimodal assistant with active maintenance
• you lack a GPU or cannot run multiple large vision models locally
• you need a permissively licensed project for commercial use

Facets

framework · maturity maintenance

agent-framework llm-inference image-processing machine-learning chatbot artificial-intelligence large-language-models computer-vision image-processing python cross-platform visual-chatgpt foundation-models stable-diffusion image-editing multimodal chatgpt ai-agents gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="chenfei-wu/TaskMatrix")