volcengine/veScale
Some data may be outdated — see provenance labels.
Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs observed · 2026-10-02
Health v2 · maintenance only
54/100
- Activity 62
- Release rhythm 35
- Longevity 69
Flags: no_releases
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 967
- days_rel: n/a
- days_push: 231
- n_releases_24m: 0
Adoption not part of the score
1041 stars · 65 forks observed · 2026-10-02
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
veScale is a PyTorch distributed training library from ByteDance for hyperscale training of large language models and reinforcement learning workloads. It provides eager-mode SPMD tensor programming and a flexible, high-performance FSDP implementation.
Use cases
- train large language models across many GPUs
- run distributed FSDP training at scale
- train RL models with PyTorch distributed
- shard tensors with ragged sharding in DTensor
- scale PyTorch training to hyperscale clusters
When to choose
- you need a PyTorch-native distributed LLM training library
- you want a flexible high-performance alternative to stock FSDP
- you train LLMs or RL workloads on large GPU clusters
When to avoid
- you need a stable, feature-complete framework today (the repo is mid-migration with old code moved to legacy/)
- you train small models on a single GPU
- you need a framework-agnostic solution outside PyTorch
Facets
library · maturity experimental
llm-training machine-learning deep-learning machine-learning deep-learning large-language-models gpu-computing python pytorch distributed-training fsdp reinforcement-learning spmd dtensor gpu linux
2 sources
- readme: https://github.com/volcengine/veScale · fetched 2026-10-02 · 503665393282
- registry_pypi: https://pypi.org/pypi/vescale/json · fetched 2026-08-29 · a2dd1259dade
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| volcengine/veScale | main | 54 |
For agents
markdown · JSON · MCP: product_card(name="volcengine/veScale")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem