weld-project/weld

Health v2 · maintenance only

Adoption not part of the score

3006 stars · 252 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Weld is a language and high-performance runtime that optimizes data-intensive analytics workflows by expressing computations in a common intermediate representation and compiling them with LLVM. It lets libraries like Pandas (via Grizzly) defer and jointly optimize across framework boundaries instead of moving data between isolated functions.

Use cases

• speed up pandas workflows that are bottlenecked by data movement
• compile and optimize multi-library analytics pipelines end to end
• accelerate machine learning preprocessing in Python
• build a JIT compiler for data analytics code
• reduce overhead when chaining NumPy/Pandas operations

When to choose

• your analytics pipeline spends most time moving data between library calls
• you want LLVM-based code generation for data-intensive workloads
• you need cross-library optimization of Pandas-like computations

When to avoid

• you need a project with frequent updates and modern Rust/LLVM support
• your workload is small enough that data movement overhead is negligible
• you need production support for LLVM versions newer than 6.0

Facets

library · maturity maintenance

compiler interpreter machine-learning data-science benchmarking data-science analytics performance compilers machine-learning rust cpp python llvm intermediate-representation pandas code-generation jit-compilation data-analytics macos linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="weld-project/weld")