SakanaAI/text-to-lora
Some data may be outdated — see provenance labels.
Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input observed · 2026-09-27
Health v2 · maintenance only
28/100
- Activity 17
- Release rhythm 35
- Longevity 38
Flags: no_releases
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 533
- days_rel: n/a
- days_push: 499
- n_releases_24m: 0
Adoption not part of the score
1307 stars · 92 forks observed · 2026-09-27
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Text-to-LoRA (T2L) is a hypernetwork that generates LoRA adapters for large language models in a single forward pass, using only a natural language task description as input. This repository is the reference implementation with CLI LoRA generation, evaluation scripts, and a web UI demo.
Use cases
- generate a LoRA adapter from a text task description
- adapt an LLM to a new task without fine-tuning
- compress many task-specific LoRA adapters into one model
- zero-shot generalize adapters to unseen tasks
- evaluate generated LoRAs on benchmarks like GSM8K and Arc
When to choose
- you want task-specific LLM adaptation without dataset curation or training
- you need to serve many specialized LoRAs cheaply
- you're researching hypernetworks or parameter-efficient fine-tuning
When to avoid
- you need fully trained, high-accuracy adapters for production tasks
- you lack a >16GB GPU
- you need a battle-tested enterprise fine-tuning pipeline rather than research code
Facets
library · maturity active
machine-learning llm-training llm-inference large-language-models machine-learning artificial-intelligence python hypernetwork lora fine-tuning peft research-code transformers gpu linux
6 sources
- readme: https://github.com/SakanaAI/text-to-lora · fetched 2026-09-27 · 5c2a1babf006
- homepage: https://arxiv.org/abs/2506.06105 · fetched 2026-08-29 · 2983e04708db
- site_page: https://info.arxiv.org/about/donate.html · fetched 2026-08-29 · cca9c3a11c56
- site_page: https://info.arxiv.org/about/ourmembers.html · fetched 2026-08-29 · 47cbc55ff1de
- site_page: https://info.arxiv.org/about · fetched 2026-08-29 · a1f16f915a9a
- site_page: https://info.arxiv.org/labs/index.html · fetched 2026-08-29 · b14a8d05a0ec
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| SakanaAI/text-to-lora | main | 28 |
For agents
markdown · JSON · MCP: product_card(name="SakanaAI/text-to-lora")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem