Open-source gpu-computing software

544 open-source libraries, tools and applications tagged gpu-computing, ranked by how closely gpu-computing is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

544 products, primary matches first, then adoption-weighted; health v2 shown.

Product	Health v2	Stars	Maturity
apache/mahout Apache Mahout is an Apache Software Foundation project providing Qumat, a high-level Python library for quantum computing with a unified AP…	84	2310	active
CoinCheung/pytorch-loss A PyTorch library providing a collection of loss functions (focal loss, triplet loss, AMSoftmax, label-smooth CE, dice loss, lovasz-softmax…	32	2251	active
kubeflow/trainer Kubeflow Trainer is a Kubernetes-native platform for distributed AI model training and LLM fine-tuning across frameworks like PyTorch, JAX,…	93	2249	active
NVIDIA/cutile-python cuTile Python is a tile-based programming language and library from NVIDIA for writing parallel kernels that run on NVIDIA GPUs, compiling …	62	2151	active
soedinglab/MMseqs2 MMseqs2 is an open-source C++ suite for ultra-fast, sensitive search and clustering of huge protein and nucleotide sequence sets, running o…	69	2147	active
deepspeedai/DeepSpeed-MII DeepSpeed-MII is a Python library for high-throughput, low-latency large language model inference, built on DeepSpeed. It provides blocked …	39	2114	active
inducer/pycuda PyCUDA is a Python wrapper giving Pythonic access to Nvidia's CUDA parallel computation API, including GPUArray multidimensional arrays and…	78	2052	active
OpenMM OpenMM is a high-performance toolkit and library for molecular dynamics simulation, with optimized GPU-accelerated kernels. It can be used …	94	2000	stable
NVIDIA/Stable-Diffusion-WebUI-TensorRT An NVIDIA extension for the Stable Diffusion Web UI (Automatic1111) that accelerates image generation using TensorRT-optimized engines on R…	19	1985	active
develsoftware/GMinerRelease GMiner is a closed-source GPU cryptocurrency miner for NVIDIA and AMD cards supporting algorithms such as Ethash, ProgPoW, KAWPOW, Equihash…	64	1975	active
siliconflow/onediff OneDiff is an out-of-the-box acceleration library for diffusion models, providing PyTorch compilation tools and optimized GPU kernels. It i…	44	1965	active
CannyLab/tsne-cuda A CUDA-accelerated implementation of the FIt-SNE t-SNE algorithm with Python bindings, offering up to 1200x speedup over scikit-learn. It e…	89	1958	stable
AdaptiveCpp/AdaptiveCpp AdaptiveCpp (formerly hipSYCL/Open SYCL) is an independent, community-driven C++ compiler platform for heterogeneous programming models inc…	72	1951	active
deepseek-ai/TileKernels TileKernels is a Python library of optimized GPU kernels for LLM operations, written in the TileLang DSL. It provides kernels for MoE routi…	58	1949	active
dphnAI/sonar Sonar is a large-scale LLM inference engine for Hugging Face-compatible language and multimodal models, based on vLLM (formerly the Aphrodi…	93	1871	active
laekov/fastmoe FastMoE is a PyTorch library providing efficient Mixture of Experts (MoE) layers with custom C/CUDA operators. It supports distributed expe…	23	1860	active
TorchSharp TorchSharp is a .NET library providing bindings to LibTorch, the library that powers PyTorch, with a focus on tensors and a PyTorch-like AP…	69	1858	active
tile-ai/TileRT TileRT is a tile-based runtime for ultra-low-latency LLM inference, achieving hundreds to over 1000 tokens/s decode speeds on frontier mode…	75	1831	active
zju3dv/4K4D 4K4D is a research implementation of a 4D point cloud representation for real-time dynamic view synthesis at up to 4K resolution, built on …	71	1814	active
su2code/SU2 SU2 is an open-source C++ suite for numerically solving partial differential equations and performing PDE-constrained optimization, primari…	81	1808	active
moderngpu/moderngpu moderngpu is a header-only C++ productivity library for general-purpose GPU computing built on CUDA. It provides accelerated primitives for…	47	1796	active
FL33TW00D/whisper-turbo Whisper Turbo is a fast, cross-platform, GPU-accelerated implementation of OpenAI's Whisper speech recognition model, built on the Ratchet …	19	1794	active
0xSero/turboquant TurboQuant is a Python library implementing near-optimal KV cache quantization for LLM inference, compressing keys to 3-bit and values to 2…	57	1788	active
DTolm/VkFFT VkFFT is an open-source, GPU-accelerated multidimensional Fast Fourier Transform library supporting Vulkan, CUDA, HIP, OpenCL, Level Zero, …	53	1784	active
chenjd/Render-Crowd-Of-Animated-Characters A Unity library that bakes skeletal animation data into an animation map texture and uses GPU instancing to render tens of thousands of ani…	32	1777	active
Coyote-A/ultimate-upscale-for-automatic1111 An extension for the AUTOMATIC1111 Stable Diffusion web UI that upscales images to 2K/4K+ by processing them in tiled passes with diffusion…	32	1765	stable
ILGPU ILGPU is a just-in-time compiler for high-performance GPU programs (kernels) written in .NET languages like C# and F#, entirely in C# with …	71	1762	active
webonnx/wonnx Wonnx is a GPU-accelerated ONNX inference runtime written entirely in Rust, built on wgpu and usable natively or in the browser via WebGPU …	10	1754	active
Zaneham/Booth Booth is an open-source compiler that takes CUDA C, HIP, or Triton kernel source and emits binaries for AMD RDNA 2/3/4 GPUs, NVIDIA PTX, Te…	79	1750	active
rusty1s/pytorch_scatter A PyTorch extension library providing highly optimized scatter and segment (sparse update) operations with sum, mean, min, and max reductio…	57	1747	stable
Enzyme Enzyme is a high-performance automatic differentiation plugin for LLVM and MLIR that computes derivatives and gradients of arbitrary existi…	95	1718	active
jiaweizzhao/GaLore GaLore is a PyTorch library implementing Gradient Low-Rank Projection for memory-efficient full-parameter training of large language models…	26	1708	active
turboderp-org/exllamav3 ExLlamaV3 is a Python library for fast quantization and inference of large language models on consumer-class GPUs, featuring the EXL3 quant…	83	1678	active
NCCL NVIDIA's official test suite for NCCL that measures the performance and correctness of collective communication operations across GPUs. It …	74	1664	active
Higgsfield Higgsfield is an open-source GPU orchestration and machine learning framework for fault-tolerant, distributed training of very large models…	67	6047	maintenance
Chainer Chainer is a Python-based deep learning framework that pioneered the define-by-run approach with dynamic computational graphs and automatic…	23	5919	maintenance
ethereum-mining/ethminer Ethminer is a command-line GPU mining application for Ethash Proof of Work coins such as Ethereum and Ethereum Classic. It supports OpenCL …	10	5910	maintenance
xLLM-AI/xllm xLLM is a high-performance C++ inference engine for LLM, VLM, DiT and recommendation models, optimized for heterogeneous AI accelerators su…	80	1600	active
databricks/megablocks MegaBlocks is a lightweight Python library for efficient training of mixture-of-experts (MoE) models, built around its dropless-MoE (dMoE) …	59	1596	active
googlecolab/google-colab-cli A Python-based command-line interface for Google Colab that lets users provision CPU, GPU, and TPU runtimes, execute local scripts and note…	59	1574	active
RightNow-AI/autokernel AutoKernel is an open-source autoresearch pipeline that takes any PyTorch model, profiles it to find GPU kernel bottlenecks, extracts them …	44	1571	active
ByteDance-Seed/Triton-distributed Triton-distributed is a distributed compiler built on OpenAI Triton for computation-communication overlapping on multi-GPU systems. It lets…	61	1559	active
UCCL UCCL is a high-performance GPU communication library written in C++ that provides collectives (as a drop-in NCCL/RCCL replacement), P2P tra…	70	1545	active
intel/llvm Intel's staging area for LLVM upstream contributions and home for Intel LLVM-based projects, most notably the oneAPI DPC++ compiler impleme…	96	1537	active
Leela Zero Leela Zero is an open-source Go engine that reimplements AlphaGo Zero, combining Monte Carlo Tree Search with a deep residual convolutional…	23	5591	maintenance
beehive-lab/TornadoVM TornadoVM is a Java programming framework that JIT-compiles JVM bytecode into GPU kernels targeting NVIDIA CUDA, OpenCL, and Apple Metal at…	98	1523	active
ovg-project/kvcached kvcached is a Python library that brings OS-style virtual memory abstraction to KV cache management for LLM serving and training on shared …	72	1509	active
graphdeco-inria/diff-gaussian-rasterization A CUDA-based differentiable rasterization engine for 3D Gaussian Splatting, used in the SIGGRAPH 2023 paper '3D Gaussian Splatting for Real…	29	1506	stable
mit-han-lab/torchsparse TorchSparse is a high-performance PyTorch library for sparse convolution on 3D point clouds, with optimized GPU kernels for both training a…	23	1473	active
jax-md/jax-md JAX MD is a Python library for molecular dynamics simulations built on JAX, making them hardware accelerated on CPU, GPU, and TPU and end-t…	80	1465	active
intel/compute-runtime Intel's open-source Graphics Compute Runtime (NEO) providing OpenCL 3.0 and oneAPI Level Zero compute API support for Intel HD Graphics and…	98	1457	active
NVIDIA/MatX MatX is a C++20 header-only numerical computing library providing NumPy-like tensor expressions for NVIDIA GPUs and multithreaded CPUs. It …	92	1448	active
CliMA Earth System Model Oceananigans.jl is a Julia package for fast, flexible finite-volume simulations of incompressible fluid dynamics, solving nonhydrostatic an…	95	1439	active
JuliaGPU/CUDA.jl CUDA.jl is the main Julia package for programming NVIDIA CUDA GPUs, offering a high-level CuArray abstraction, a compiler for writing CUDA …	99	1433	stable
NVIDIA/gdrcopy GDRCopy is a low-latency GPU memory copy library built on NVIDIA GPUDirect RDMA technology, allowing CPU-driven copies between host and GPU…	83	1416	active
heterodb/pg-strom PG-Strom is a PostgreSQL extension that accelerates SQL analytics and batch workloads using GPU devices, NVMe-SSD storage, and Apache Arrow…	77	1409	active
RahulSChand/gpu_poor A web-based calculator that estimates GPU memory requirements and inference/finetuning throughput (token/s) for any LLM. It supports quanti…	19	1401	active
TheRock TheRock is AMD's open-source build and release system for the ROCm software stack, replacing the legacy monolithic ROCm release process wit…	89	1394	active
CUDA Core Compute Libraries Thrust is a C++ parallel algorithms library providing an STL-like high-level interface for GPU and multicore CPU computing, built on CUDA, …	10	5001	maintenance
bytedance/flux Flux is a GPU kernel library from ByteDance that overlaps computation with communication for tensor and expert parallelism in dense and MoE…	30	1369	active
alibaba/rtp-llm RTP-LLM is Alibaba's high-performance LLM inference engine written in C++/CUDA, optimized with kernels like PagedAttention and FlashAttenti…	65	1364	active
uxlfoundation/scikit-learn-intelex Intel's Extension for Scikit-learn is a free AI accelerator that speeds up existing scikit-learn workflows on CPUs and GPUs, claiming up to…	87	1356	active
hao-ai-lab/LookaheadDecoding A Python library implementing Lookahead Decoding, an exact parallel decoding algorithm that accelerates LLM inference without a draft model…	28	1343	active
LuxCoreRender/LuxCore LuxCoreRender is a physically based, unbiased rendering engine with a C++ and Python API (LuxCore), supporting CPU, OpenCL, CUDA, and OptiX…	99	1339	active
mapillary/inplace_abn A PyTorch extension library implementing In-Place Activated BatchNorm (InPlace-ABN), which redefines BN plus nonlinear activation as a sing…	67	1333	stable
ChenmienTan/RL2 RL2 (Ray Less Reinforcement Learning) is a concise Python library for post-training large language models with reinforcement learning, SFT,…	54	1316	active
steineggerlab/foldseek Foldseek is a command-line tool for fast and sensitive comparison, search, and clustering of large protein 3D structure sets, including mon…	65	1299	active
vipshop/cache-dit Cache-DiT is a PyTorch-native inference engine that accelerates Diffusion Transformer (DiT) models with hybrid caching, parallelism, quanti…	79	1287	active
corsix/amx A C library and documentation of Apple's undocumented AMX (Apple Matrix eXtension) instructions found on M1-M4 Apple Silicon chips, enablin…	32	1275	active
stotko/stdgpu stdgpu is a lightweight C++17 library providing STL-like generic data structures (vector, unordered_map, unordered_set, deque, queue, stack…	65	1270	active
thu-ml/SpargeAttn SpargeAttn is the official implementation of a training-free sparse and quantized attention method that accelerates inference for language,…	48	1257	active
MoonshotAI/FlashKDA FlashKDA is a set of high-performance CUDA kernels (built on CUTLASS) implementing Kimi Delta Attention, a linear attention mechanism, for …	56	1256	active
wcandillon/react-native-webgpu A React Native library that brings the WebGPU API to mobile and desktop apps, powered by Dawn (Chrome's WebGPU implementation). It supports…	90	1244	active
chelsea0x3b/cudarc cudarc is a safe, minimal Rust wrapper around the NVIDIA CUDA toolkit, exposing the CUDA driver API plus libraries such as NVRTC, cuBLAS/cu…	97	1231	active
microsoft/MInference MInference is a Microsoft library that accelerates long-context LLM inference using dynamic sparse attention, reducing pre-fill latency by …	58	1229	active
sgl-project/SpecForge SpecForge is a Python framework from the SGLang team for training speculative decoding models such as EAGLE/EAGLE3 draft heads. Trained mod…	64	1225	active
eduardoleao052/js-pytorch JS-PyTorch is a deep learning library for JavaScript that closely mirrors PyTorch's syntax, providing tensor operations, automatic differen…	17	1221	active
cp2k/cp2k CP2K is an open-source quantum chemistry and solid state physics package for atomistic simulations of molecular, liquid, periodic, and biol…	83	1217	stable
AlgRUC/JittorGeometric JittorGeometric is a graph machine learning library built on the Jittor deep learning framework, providing implementations of 40+ Graph Neu…	59	1200	active
CNugteren/CLBlast CLBlast is a lightweight, tunable OpenCL BLAS library written in C++11 that implements basic linear algebra subprograms for vectors and mat…	77	1193	stable
getkeops/keops KeOps (pykeops) is a Python library for computing kernel reductions over large arrays on CPUs and GPUs using efficient C++/CUDA routines wi…	61	1192	active
keijiro/StableFluids A GPU-based Unity implementation of Jos Stam's Stable Fluids fluid simulation using compute shaders. It exposes the velocity field for rend…	46	1172	active
Tencent/hpc-ops HPC-Ops is a production-grade C++/CUDA operator library for high-performance LLM inference, developed by Tencent's Hunyuan AI Infra team. I…	58	1170	active
warp-ctc A fast parallel implementation of the Connectionist Temporal Classification (CTC) loss function for CPU and CUDA GPU, with a simple C inter…	32	4066	maintenance
XMR-Stak xmr-stak is a free, open-source, high-performance miner for Monero (RandomX) and unified CryptoNight-based cryptocurrencies, supporting CPU…	23	4060	maintenance
Dao-AILab/quack QuACK is a collection of high-performance GPU kernels (RMSNorm, LayerNorm, softmax, cross-entropy, GEMM with epilogues) written in NVIDIA's…	83	1167	active
extropic-ai/thrml THRML is a JAX library for building and sampling probabilistic graphical models, focused on efficient block Gibbs sampling of energy-based …	70	1167	active
IST-DASLab/marlin Marlin is a highly optimized FP16xINT4 matrix multiplication CUDA kernel for LLM inference that achieves near-ideal 4x speedups at batch si…	26	1164	active
inducer/pyopencl PyOpenCL is a Python wrapper providing Pythonic access to the OpenCL parallel computation API, letting you run kernels on GPUs and other ma…	97	1156	stable
nnaisense/evotorch EvoTorch is an open-source evolutionary computation library built on top of PyTorch, developed at NNAISENSE. It provides distribution-based…	75	1148	active
MoonshotAI/MoonEP MoonEP is an Expert Parallelism communication library for Mixture-of-Experts training that keeps token loads perfectly balanced across rank…	56	1146	active
uncomplicate/neanderthal Neanderthal is a fast Clojure library for matrix and linear algebra computations built on optimized native BLAS and LAPACK routines, suppor…	73	1130	active
luchris429/purejaxrl PureJaxRL provides end-to-end reinforcement learning training pipelines implemented entirely in JAX, including environments, enabling massi…	31	1118	active
Lasagne Lasagne is a lightweight Python library for building and training neural networks on top of Theano. It supports feed-forward, convolutional…	23	3858	maintenance
rusty1s/pytorch_sparse A PyTorch extension library providing optimized sparse matrix operations (coalesce, transpose, sparse-dense and sparse-sparse multiplicatio…	57	1106	active
sirius-db/sirius Sirius is a GPU-native SQL analytics engine written in C++ that accelerates query execution by offloading it to GPUs. It integrates with ex…	78	1093	active
pocl/pocl PoCL (Portable Computing Language) is an MIT-licensed, conformant open-source implementation of the OpenCL 3.0 standard that can be easily …	85	1083	active
NVIDIA-Merlin/HugeCTR HugeCTR is a GPU-accelerated deep learning framework from NVIDIA designed for training and inference of large recommender models, especiall…	71	1073	active
limbo018/DREAMPlace DREAMPlace is a GPU-accelerated VLSI placement tool that reformulates placement as a deep-learning-like optimization using PyTorch. It supp…	70	1061	active
zhuzilin/ring-flash-attention A Python library implementing RingAttention on top of FlashAttention for distributed long-context transformer training. It provides varlen …	38	1061	active