TencentQQGYLab/ELLA

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1289 stars · 65 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ELLA is an Efficient Large Language Model Adapter that equips text-to-image diffusion models with LLM-based text understanding via a Timestep-Aware Semantic Connector, without retraining the U-Net or LLM. It also introduces DPG-Bench for evaluating dense prompt following and includes an EMMA extension for multi-modal prompts.

Use cases

• improve dense prompt following in stable diffusion
• generate images from long complex prompts
• adapt SD1.5 with an LLM text encoder
• benchmark text-to-image models on dense prompts
• use ELLA in ComfyUI workflows
• enable multi-modal prompts in diffusion models

When to choose

• your diffusion model struggles with dense prompts with multiple objects and relationships
• you want LLM-enhanced text alignment without retraining U-Net or LLM
• you need a benchmark for dense prompt following

When to avoid

• you need a production-ready text-to-image service out of the box
• you work with diffusion models other than SD1.5 without adaptation
• you lack GPU resources for LLM-backed inference

Facets

library · maturity active

machine-learning deep-learning llm-inference image-processing artificial-intelligence machine-learning large-language-models image-processing python text-to-image diffusion-models stable-diffusion semantic-alignment adapter tsc dpg-bench comfyui gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="TencentQQGYLab/ELLA")