SakanaAI/text-to-lora

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1300 stars · 89 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Text-to-LoRA (T2L) is a hypernetwork that generates LoRA adapters for large language models in a single forward pass, using only a natural language task description as input. This repository is the reference implementation with CLI LoRA generation, evaluation scripts, and a web UI demo.

Use cases

• generate a LoRA adapter from a text task description
• adapt an LLM to a new task without fine-tuning
• compress many task-specific LoRA adapters into one model
• zero-shot generalize adapters to unseen tasks
• evaluate generated LoRAs on benchmarks like GSM8K and Arc

When to choose

• you want task-specific LLM adaptation without dataset curation or training
• you need to serve many specialized LoRAs cheaply
• you're researching hypernetworks or parameter-efficient fine-tuning

When to avoid

• you need fully trained, high-accuracy adapters for production tasks
• you lack a >16GB GPU
• you need a battle-tested enterprise fine-tuning pipeline rather than research code

Facets

library · maturity active

machine-learning llm-training llm-inference large-language-models machine-learning artificial-intelligence python hypernetwork lora fine-tuning peft research-code transformers gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="SakanaAI/text-to-lora")