OpenDCAI/DataFlex
Some data may be outdated — see provenance labels.
Data-centric LLM training with dynamic sample selection, domain mixture optimization, and example reweighting inside the LLaMA-Factory training loop. observed · 2026-09-24
Health v2 · maintenance only
63/100
- Activity 94
- Release rhythm 40
- Longevity 31
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 437
- days_rel: 187
- days_push: 40
- n_releases_24m: 1
Adoption not part of the score
2824 stars · 399 forks observed · 2026-09-24
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
DataFlex is a data-centric training framework built on LLaMA-Factory that dynamically schedules LLM training data during optimization. It provides reproducible implementations of data selection, data mixture optimization, and example reweighting inside the training loop.
Use cases
- dynamically select training samples for LLM fine-tuning
- optimize domain mixture of training data
- reweight training examples during model training
- improve reproducibility of LLM training experiments
- focus training on hard samples
- train larger models with DeepSpeed ZeRO-3 gradient computation
When to choose
- you already use LLaMA-Factory and want smarter data scheduling
- you need reproducible data selection, mixture, and reweighting in one framework
- you want to improve model performance by curating training data dynamically
When to avoid
- you train models outside the LLaMA-Factory ecosystem
- you need a general-purpose data pipeline unrelated to LLM training
- you require a fully stable, long-proven production system
Facets
framework · maturity active
machine-learning llm-training data-science etl large-language-models machine-learning data-science deep-learning python data-selection data-mixture data-reweighting data-centric-ai llama-factory training-data-scheduling gpu linux
3 sources
- readme: https://github.com/OpenDCAI/DataFlex · fetched 2026-09-24 · 8bbeaf5a53b1
- homepage: https://opendcai.github.io/DataFlex-Doc/ · fetched 2026-08-29 · 1260f20fe66e
- registry_pypi: https://pypi.org/pypi/dataflex/json · fetched 2026-08-29 · ce308c4f7851
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| OpenDCAI/DataFlex | main | 63 |
For agents
markdown · JSON · MCP: product_card(name="OpenDCAI/DataFlex")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem