thu-ml/unidiffuser

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1486 stars · 90 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

UniDiffuser is a unified diffusion framework that fits marginal, conditional, and joint distributions across image and text modalities in a single transformer-based model (U-ViT). It supports image generation, text generation, text-to-image, image-to-text, and image-text pair generation with one set of pretrained models.

Use cases

• generate images from text prompts
• generate text captions from images
• generate image-text pairs with one model
• research multi-modal diffusion models
• compare unified generative models against Stable Diffusion or DALL-E 2
• run a text-to-image model locally on GPU

When to choose

• you need one model handling multiple generation tasks (text-to-image, image-to-text, joint generation)
• you are researching unified multi-modal diffusion architectures
• you want pretrained models with Hugging Face Diffusers integration

When to avoid

• you only need state-of-the-art text-to-image generation for production
• you lack a GPU or cannot tolerate heavy model downloads
• you need actively maintained software with frequent updates

Facets

library · maturity maintenance

machine-learning deep-learning image-processing nlp llm-inference deep-learning artificial-intelligence image-processing large-language-models python cross-platform diffusion-models text-to-image multi-modal transformer research-code uvit image-generation image-to-text natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="thu-ml/unidiffuser")