Open-source gpu-computing software

544 open-source libraries, tools and applications tagged gpu-computing, ranked by how closely gpu-computing is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

544 products, primary matches first, then adoption-weighted; health v2 shown.

Product	Health v2	Stars	Maturity
vLLM vLLM is a high-throughput, memory-efficient inference and serving engine for large language models, featuring PagedAttention, continuous ba…	98	94014	active
lyogavin/airllm AirLLM is a Python library that enables running extremely large language models on a single low‑VRAM GPU. It achieves this without quantiza…	95	39932	active
XGBoost XGBoost is an optimized, scalable gradient boosting library implementing parallel tree boosting (GBDT/GBM) with bindings for Python, R, Jav…	94	28887	stable
InvokeAI Invoke is a self-hosted, open-source creative engine for AI image generation with Stable Diffusion models (SD 1.5, SDXL, Flux), featuring a…	100	28742	active
Taichi Taichi Lang is an open-source domain-specific language embedded in Python for high-performance parallel numerical computation, using a JIT …	60	28390	active
Dao-AILab/flash-attention Official implementation of FlashAttention, FlashAttention-2, -3, and -4: fast and memory-efficient exact attention kernels for GPUs. It acc…	92	25116	active
Bend Bend is a fast, parallel programming language with built‑in dependent types and proof checking. It compiles to native CPU and GPU code and …	95	23454	active
triton-lang/triton Triton is an open‑source programming language and compiler for writing high‑performance custom deep‑learning primitives. It targets GPUs an…	93	20386	active
TensorFlow.js TensorFlow.js is a hardware-accelerated JavaScript library for training and deploying machine learning models in the browser and Node.js. I…	59	19147	stable
wgpu wgpu is a cross-platform, safe, pure-Rust graphics API based on the WebGPU standard. It runs natively on Vulkan, Metal, D3D12, and OpenGL, …	97	18311	stable
Codon Codon is a high-performance Python compiler that statically compiles Python-like code to native machine code via LLVM, typically achieving …	98	16858	active
PavelDoGreat/WebGL-Fluid-Simulation A browser-based interactive fluid simulation built with WebGL that solves Navier-Stokes equations on the GPU. It runs as a web demo and wor…	32	16652	stable
gpujs/gpu.js GPU.js is a JavaScript acceleration library for GPGPU that automatically transpiles JavaScript functions into shader language (GLSL) and co…	98	15505	active
ggml-org/ggml ggml is a plain C/C++ tensor library for machine learning with no dependencies, designed to be simple, portable, and efficient. It supports…	99	15480	stable
vosen/ZLUDA ZLUDA is a drop-in replacement layer for CUDA that lets unmodified CUDA applications run on non-NVIDIA GPUs with near-native performance. I…	83	15103	active
NVIDIA/TensorRT-LLM NVIDIA's TensorRT-LLM is a Python library and runtime for defining and serving Large Language Models with state-of-the-art inference optimi…	83	14851	active
dmlc/dgl DGL (Deep Graph Library) is a Python package for deep learning on graph-structured data, built on top of existing frameworks like PyTorch, …	34	14281	stable
deepseek-ai/FlashMLA FlashMLA is DeepSeek's library of optimized CUDA attention kernels implementing Multi-head Latent Attention (MLA), including dense and toke…	64	13063	active
Numba Numba is an open-source NumPy-aware JIT compiler that translates a subset of Python and NumPy code into fast machine code using LLVM. It su…	94	11175	stable
NVIDIA/cutlass CUTLASS is NVIDIA's collection of CUDA C++ template abstractions and Python DSLs for implementing high-performance GEMM and related linear …	98	10580	active
huggingface/accelerate Hugging Face Accelerate is a Python library that lets you run the same PyTorch training and inference code on any device or distributed con…	94	9916	stable
Tiiny-AI/PowerInfer PowerInfer is a CPU/GPU hybrid LLM inference engine that exploits activation locality to run large language models fast on consumer-grade h…	60	9814	active
NVIDIA/cudf cuDF is a GPU-accelerated DataFrame library for tabular data processing, part of NVIDIA's RAPIDS suite. It provides a pandas-compatible Pyt…	95	9780	stable
Gyroflow Gyroflow is an open-source, cross-platform application that stabilizes video using gyroscope (and optionally accelerometer) motion data log…	70	9592	stable
OneFlow OneFlow is an open-source deep learning framework written in C++ with a PyTorch-like Python API, focused on scalable and efficient distribu…	44	9437	active
CatBoost CatBoost is an open-source gradient boosting on decision trees library developed by Yandex, offering high-quality classification, regressio…	82	9133	stable
NVIDIA/apex NVIDIA-maintained PyTorch extension providing utilities for easy mixed precision and distributed training. It offers up-to-date CUDA and C+…	75	9000	active
deepseek-ai/DeepGEMM DeepGEMM is a high-performance CUDA BLAS kernel library for NVIDIA tensor cores, providing FP8, FP4, and BF16 GEMMs plus fused MoE and othe…	82	8937	active
tile-ai/tilelang TileLang is a Pythonic domain-specific language and compiler (built on TVM) for writing high-performance GPU/CPU/accelerator kernels such a…	90	8658	active
InternLM/lmdeploy LMDeploy is a toolkit for compressing, quantizing, deploying, and serving large language models, built around its high-performance TurboMin…	96	8107	active
TheLastBen/fast-stable-diffusion A collection of Google Colab notebooks for quickly running Stable Diffusion UIs (AUTOMATIC1111, ComfyUI) and training DreamBooth models for…	53	7911	active
kroma-network/tachyon Tachyon is a modular zero-knowledge (ZK) proving backend written in C++17, designed to let developers implement arbitrary proving schemes w…	20	7640	active
EmbarkStudios/rust-gpu rust-gpu is a compiler toolchain that makes Rust a first-class language for writing GPU graphics and compute shaders, compiling Rust code t…	10	7557	active
NVIDIA/warp NVIDIA Warp is a Python framework that JIT-compiles regular Python functions into efficient CPU or CUDA GPU kernels. It provides differenti…	99	7215	active
drumih/turbo-fieldfare TurboFieldfare is a custom Swift + Metal runtime that runs Gemma 4 26B-A4B inference in roughly 2 GB of RAM on Apple Silicon Macs by stream…	79	6880	active
kvcache-ai/Mooncake Mooncake is a KVCache-centric disaggregated serving platform for LLM inference, originally built to serve Kimi by Moonshot AI. It separates…	90	6835	active
flashinfer-ai/flashinfer FlashInfer is a GPU kernel library and kernel generator for LLM inference, providing unified APIs for attention, GEMM, and MoE operations w…	92	6728	active
linkedin/Liger-Kernel Liger Kernel is a collection of Triton kernels designed to make LLM training faster and more memory-efficient, offering drop-in replacement…	91	6664	active
halide/Halide Halide is an embedded DSL (in C++ and Python) for writing high-performance, data-parallel image and array processing pipelines. It separate…	68	6620	stable
meta-pytorch/gpt-fast A minimal (<1000 lines) PyTorch-native implementation of fast transformer text generation, demonstrating low-latency LLM inference with int…	41	6254	active
LWJGL 3 LWJGL 3 is a Java library providing cross-platform, high-performance bindings to native APIs such as OpenGL, Vulkan, OpenAL, OpenCL, and Op…	90	5475	stable
armory3d/armorpaint ArmorPaint is a stand-alone 3D PBR texture painting application that runs entirely on the GPU, supporting node-based procedural materials, …	85	5323	active
NVIDIA/cuml NVIDIA cuML is a GPU-accelerated machine learning library offering scikit-learn-style estimators that run on NVIDIA GPUs via CUDA. It also …	91	5292	active
ProjectPhysX/FluidX3D FluidX3D is a high-performance lattice Boltzmann method computational fluid dynamics (CFD) application written in C++/OpenCL. It runs on al…	90	5290	active
NCCL NVIDIA's Collective Communication Library (NCCL) is a C++ library providing topology-aware, high-bandwidth inter-GPU communication primitiv…	99	5165	stable
ztxz16/fastllm fastllm is a high-performance C++ LLM inference library with its own custom operators, requiring no PyTorch dependency. It supports tensor-…	75	5110	active
spaceandtimefdn/blitzar Blitzar is a C++ library (with Rust bindings) that accelerates zero-knowledge proof algorithms on CPU and GPU using CUDA. It was built by S…	84	4863	active
openxla/xla XLA (Accelerated Linear Algebra) is an open-source machine learning compiler that optimizes models from frameworks like PyTorch, TensorFlow…	77	4605	active
st-tech/ppf-contact-solver A GPU-accelerated contact solver for physics-based simulations of shells (cloth), solids, rods, rigid bodies, and sand, originally develope…	87	4513	active
HIP HIP is a C++ runtime API and kernel programming language for AMD GPUs that mirrors the NVIDIA CUDA programming interface. It enables develo…	90	4406	active
AI4Finance-Foundation/ElegantRL ElegantRL is a lightweight, modular deep reinforcement learning library built on PyTorch that implements core model-free RL algorithms (PPO…	50	4368	active
uxlfoundation/oneDNN oneDNN is an open-source cross-platform performance library providing optimized building blocks (primitives) for deep learning applications…	99	4067	stable
AnswerDotAI/gpu.cpp A lightweight, header-only C++20 library for portable low-level GPU compute built on Dawn's WebGPU implementation. It provides a minimal AP…	74	3990	active
thu-ml/SageAttention SageAttention is a family of quantized attention kernels (INT8/FP8/FP4) that accelerate transformer inference 2-5x over FlashAttention with…	38	3956	active
GPyTorch GPyTorch is a Gaussian process library built on PyTorch, designed for scalable, flexible, and modular GP models. It uses linear algebra tec…	82	3925	stable
NVIDIA/k8s-device-plugin NVIDIA's official Kubernetes device plugin that exposes NVIDIA GPUs as schedulable resources in Kubernetes clusters. It supports GPU sharin…	94	3901	stable
servo/pathfinder Pathfinder 3 is a fast GPU-based rasterizer for fonts and vector graphics, usable from Rust or C/C++ via a canvas-like API. It supports Ope…	54	3896	active
HazyResearch/ThunderKittens ThunderKittens is a C++/CUDA framework of tile-based primitives for writing fast deep learning GPU kernels. It embeds natively into CUDA so…	68	3754	active
PaddlePaddle/FastDeploy FastDeploy is a high-performance inference and deployment toolkit for large language models and vision-language models built on PaddlePaddl…	82	3719	active
mmp/pbrt-v4 pbrt-v4 is the C++ physically based ray tracing system accompanying the fourth edition of the book 'Physically Based Rendering: From Theory…	74	3706	stable
mit-han-lab/llm-awq AWQ is a Python library implementing Activation-aware Weight Quantization for compressing large language models to low-bit (INT3/4) weights…	41	3638	active
holoviz/datashader Datashader is a Python data rasterization pipeline that renders very large datasets into fixed-size images by projecting, aggregating, and …	88	3568	active
google-ai-edge/LiteRT LiteRT is Google's successor to TensorFlow Lite, an on-device runtime for high-performance ML and GenAI inference on edge platforms. It pro…	86	3510	active
NVIDIA/cuda-python NVIDIA's official Python package for accessing the CUDA platform, providing Pythonic APIs and low-level bindings to CUDA C APIs, parallel a…	95	3399	active
ikawrakow/ik_llama.cpp A fork of llama.cpp offering state-of-the-art quantization types and improved CPU/CUDA inference performance for large language models. It …	60	3304	active
software-mansion/TypeGPU TypeGPU is a modular TypeScript toolkit for WebGPU that provides advanced type inference and lets developers write WGSL shaders directly in…	93	3267	active
orhun/ratty Ratty is a GPU-rendered terminal emulator written in Rust with Ratatui that supports inline 3D graphics alongside traditional 2D terminal r…	77	3267	active
determined-ai/determined Determined is an open-source deep learning platform that combines distributed training, hyperparameter tuning, experiment tracking, and GPU…	36	3245	active
facebook/igl Facebook's Intermediate Graphics Library (IGL) is a cross-platform C++ library that provides a single low-level interface for commanding th…	72	3236	active
Sergio0694/ComputeSharp ComputeSharp is a .NET library that lets developers write compute and pixel shaders in C# and run them in parallel on the GPU via DirectX 1…	73	3173	stable
lammps/lammps LAMMPS (Large-scale Atomic/Molecular Massively Parallel Simulator) is an open-source classical molecular dynamics simulation code focused o…	95	3104	stable
leggedrobotics/rsl_rl RSL-RL is a GPU-accelerated, lightweight reinforcement learning library for robotics research, featuring algorithms like PPO and Student-Te…	97	3075	active
PixarAnimationStudios/OpenSubdiv OpenSubdiv is a set of open-source C++ libraries implementing high-performance subdivision surface evaluation on massively parallel CPU and…	76	3075	stable
deepseek-ai/DualPipe DualPipe is a Python library implementing a bidirectional pipeline parallelism algorithm that overlaps forward and backward computation wit…	45	3017	active
thu-pacman/chitu Chitu (赤兔) is a high-performance inference framework for large language models, positioned as a production-grade LLM serving engine. It sup…	82	3009	active
ispc/ispc Intel ISPC is a compiler for a C-based SPMD (single program, multiple data) language that targets SIMD vector units on CPUs and GPUs. It le…	95	2984	stable
Luce-Org/lucebox Lucebox is an open-source LLM inference engine written in C++ with custom CUDA/HIP kernels, focused on speculative decoding and speculative…	60	2941	active
elixir-nx/nx Nx is an Elixir library providing multi-dimensional arrays (tensors) and numerical definitions with pluggable backends. The monorepo also i…	98	2915	active
Lolliedieb/lolMiner-releases lolMiner is a closed-source GPU cryptocurrency miner for AMD, Nvidia, and Intel graphics cards supporting many proof-of-work algorithms suc…	50	2890	active
rednote-machine-learning/RedKnot RedKnot is a long-context LLM inference acceleration library built on SGLang, using head-classified KV reuse, offline KV storage with RoPE …	56	2840	active
diku-dk/futhark Futhark is a purely functional, statically typed data-parallel array programming language in the ML family, developed at the University of …	95	2809	active
Mega4alik/ollm oLLM is a lightweight Python library for large-context LLM inference built on Hugging Face Transformers and PyTorch. It offloads weights an…	57	2798	active
FasterDecoding/Medusa Medusa is a framework that accelerates LLM text generation by adding multiple decoding heads to an existing model, avoiding the need for a …	19	2776	active
RenderKit/embree Intel Embree is a high-performance ray tracing kernel library providing optimized primitive intersection and acceleration structure constru…	76	2756	stable
xdit-project/xDiT xDiT is a scalable inference engine for Diffusion Transformers (DiTs) that enables parallel deployment across multiple GPUs and machines. I…	91	2732	active
lightseekorg/tokenspeed TokenSpeed is a high-performance LLM inference engine designed for agentic workloads, aiming for TensorRT-LLM-level performance with vLLM-l…	77	2732	active
CVCUDA/CV-CUDA CV-CUDA is an open-source GPU-accelerated library of computer vision and image processing operators built on CUDA, with C++ and Python APIs…	92	2729	active
Kokkos Kokkos Core is a C++ programming model providing abstractions for parallel execution and memory management to write performance-portable ap…	98	2707	stable
Const-me/Whisper A Windows port of whisper.cpp that runs OpenAI's Whisper speech recognition model on the GPU via DirectCompute (Direct3D 11 compute shaders…	66	10678	maintenance
meta-pytorch/torchrec TorchRec is a PyTorch domain library for building recommendation systems at scale. It provides distributed sharding of large embedding tabl…	95	2615	active
KomputeProject/kompute Kompute is a general-purpose GPU compute framework built on Vulkan that works across vendor GPUs (AMD, NVIDIA, Qualcomm, etc.) with both C+…	63	2577	active
pykeio/ort ort is a safe, fast Rust binding for Microsoft's ONNX Runtime, providing hardware-accelerated machine learning inference and training for O…	91	2569	active
mirage-project/mirage Mirage Persistent Kernel (MPK) is a compiler and runtime that transforms multi-GPU LLM inference into a single fused megakernel, reducing i…	81	2560	active
SafeAILab/EAGLE EAGLE is the official implementation of the EAGLE family of speculative decoding algorithms (EAGLE-1/2/3) for accelerating LLM text generat…	54	2542	active
CUDA Core Compute Libraries CUDA Core Compute Libraries (CCCL) is NVIDIA's unified repository for Thrust, CUB, and libcudacxx, providing high-performance C++ abstracti…	99	2541	active
lupinemachines/lupine LUPINE is a GPU-over-IP bridge that lets machines without local GPUs attach NVIDIA GPUs running on remote servers over the network. It expo…	91	2452	active
tracel-ai/cubecl CubeCL is a Rust language extension, JIT compiler, and runtime set for writing high-performance GPU compute kernels in plain Rust. A single…	83	2437	active
idaholab/moose MOOSE is a finite-element, multiphysics simulation framework developed by Idaho National Laboratory, built on top of PETSc's nonlinear solv…	77	2388	stable
FMInference/FlexLLMGen FlexLLMGen is a high-throughput generation engine for running large language models on a single GPU with limited memory. It uses IO-efficie…	10	9346	maintenance
wilicc/gpu-burn GPU Burn is a multi-GPU CUDA stress test tool that pushes NVIDIA GPUs to maximum load for stability and thermal testing. It supports config…	76	2356	active