adobe-research/custom-diffusion

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1978 stars · 140 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Custom Diffusion is a research codebase for efficiently fine-tuning text-to-image diffusion models like Stable Diffusion on a few example images (4-20) of a new concept. It updates only key and value projection matrices in cross-attention layers, enabling fast training (~6 minutes on 2 A100 GPUs), small per-concept storage (75MB), and composition of multiple customized concepts.

Use cases

• teach stable diffusion to generate images of my pet from a few photos
• fine-tune a text-to-image model on a custom artistic style
• combine multiple learned concepts like an object plus a style in one generation
• create images of a personal toy or product in new settings
• evaluate concept customization methods with the CustomConcept101 dataset
• train a lightweight adapter for stable diffusion with low storage cost

When to choose

• you want to personalize Stable Diffusion with only a handful of example images
• you need fast fine-tuning with minimal GPU time and small per-concept checkpoints
• you want to compose multiple custom concepts (objects, styles, categories) in one model
• you need a research baseline or dataset for comparing personalization methods

When to avoid

• you need a production-grade, well-supported training pipeline rather than research code
• you have no GPU resources available
• you want to fine-tune models other than Stable Diffusion-family diffusion models
• you prefer a maintained integration - in that case use the Custom Diffusion implementation in Hugging Face diffusers instead

Facets

library · maturity stable

machine-learning deep-learning llm-training image-processing machine-learning computer-vision image-processing artificial-intelligence python diffusion-models stable-diffusion fine-tuning text-to-image few-shot-learning customization pytorch cvpr-2023 research-code gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="adobe-research/custom-diffusion")