xorbitsai/xorbits

Health v2 · maintenance only

Adoption not part of the score

1199 stars · 69 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Xorbits is an open-source distributed computing framework that scales Python data science and machine learning workloads from a laptop to large clusters. It offers APIs compatible with pandas, NumPy, PyTorch, XGBoost, and LightGBM, often requiring only a one-line code change to scale existing workflows.

Use cases

• scale pandas dataframes beyond single-machine memory
• speed up numpy computations using multiple cores or GPUs
• distribute XGBoost or LightGBM model training across a cluster
• run data preprocessing pipelines on terabytes of data
• accelerate existing notebooks without rewriting code
• serve and tune ML models at scale

When to choose

• your pandas or numpy workflows outgrow a single machine
• you want pandas-like APIs with distributed execution
• you need to scale ML training and serving with minimal code changes
• you want multi-core or GPU acceleration on a single node

When to avoid

• your datasets fit comfortably in memory with pandas
• you need a mature ecosystem like Dask or Ray with broader community support
• you require strict pandas API parity for edge-case behaviors
• you only need simple single-node data processing

Facets

library · maturity active

data-science machine-learning etl streaming data-science machine-learning big-data microservices python cloud pandas-compatible numpy-compatible distributed-computing xgboost lightgbm gpu-acceleration scalable-dataframes data-engineering linux macos docker kubernetes

Member repositories

For agents

markdown · JSON · MCP: product_card(name="xorbitsai/xorbits")