Ross ROSS = Recommend OSS · open-source software intelligence for agents

function: gpu-computing

559 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
vllm-project/vllm
vLLM is a high-throughput, memory-efficient inference and serving engine for large language models, featuring PagedAttention, continuous ba…
9390149active
dmlc/xgboost
XGBoost is an optimized, scalable gradient boosting library implementing parallel tree boosting (GBDT/GBM) with bindings for Python, R, Jav…
9528694stable
Taichi
Taichi Lang is an open-source domain-specific language embedded in Python for high-performance parallel numerical computation, using a JIT …
6428345active
invoke-ai/InvokeAI
Invoke is a self-hosted, open-source creative engine for AI image generation with Stable Diffusion models (SD 1.5, SDXL, Flux), featuring a…
9928015active
hashcat
Hashcat is the world's fastest and most advanced password recovery utility, supporting over 300 highly-optimized hashing algorithms across …
8026631active
JustVugg/colibri
Colibrì is a pure-C, zero-dependency inference engine that runs frontier Mixture-of-Experts models (744B to 2.8T parameters) on consumer ha…
8026251active
Dao-AILab/flash-attention
Official implementation of FlashAttention, FlashAttention-2, -3, and -4: fast and memory-efficient exact attention kernels for GPUs. It acc…
9524787active
antirez/ds4
DwarfStar (ds4) is a self-contained native LLM inference engine written in C, optimized for DeepSeek V4 Flash and PRO and GLM 5.2, with sup…
5821807active
triton-lang/triton
Triton is an open-source language and compiler for writing highly efficient custom deep-learning GPU kernels with Python-level productivity…
9220017active
kvcache-ai/ktransformers
KTransformers is a Python/C++ framework for CPU-GPU heterogeneous inference and fine-tuning of large language models, with a kt-kernel back…
9019303active
tensorflow/tfjs
TensorFlow.js is a hardware-accelerated JavaScript library for training and deploying machine learning models in the browser and Node.js. I…
6919134stable
lightgbm-org/LightGBM
LightGBM is a fast, distributed, high-performance gradient boosting framework based on decision tree algorithms, with APIs for Python, R, C…
8618714stable
wgpu
wgpu is a cross-platform, safe, pure-Rust graphics API based on the WebGPU standard. It runs natively on Vulkan, Metal, D3D12, and OpenGL, …
9917870stable
exaloop/codon
Codon is a high-performance Python compiler that statically compiles Python-like code to native machine code via LLVM, typically achieving …
9016834active
PavelDoGreat/WebGL-Fluid-Simulation
A browser-based interactive fluid simulation built with WebGL that solves Navier-Stokes equations on the GPU. It runs as a web demo and wor…
3216591stable
gpujs/gpu.js
GPU.js is a JavaScript acceleration library for GPGPU that automatically transpiles JavaScript functions into shader language (GLSL) and co…
9715370active
ggml-org/ggml
ggml is a plain C/C++ tensor library for machine learning with no dependencies, designed to be simple, portable, and efficient. It supports…
9915236stable
vosen/ZLUDA
ZLUDA is a drop-in replacement layer for CUDA that lets unmodified CUDA applications run on non-NVIDIA GPUs with near-native performance. I…
8514777active
NVIDIA/TensorRT-LLM
NVIDIA's TensorRT-LLM is a Python library and runtime for defining and serving Large Language Models with state-of-the-art inference optimi…
8414483active
dmlc/dgl
DGL (Deep Graph Library) is a Python package for deep learning on graph-structured data, built on top of existing frameworks like PyTorch, …
3814282stable
deepseek-ai/FlashMLA
FlashMLA is DeepSeek's library of optimized CUDA attention kernels implementing Multi-head Latent Attention (MLA), including dense and toke…
6212872active
Numba
Numba is an open-source NumPy-aware JIT compiler that translates a subset of Python and NumPy code into fast machine code using LLVM. It su…
9411129stable
NVIDIA/cutlass
CUTLASS is NVIDIA's collection of CUDA C++ template abstractions and Python DSLs for implementing high-performance GEMM and related linear …
9910317active
huggingface/accelerate
Hugging Face Accelerate is a Python library that lets you run the same PyTorch training and inference code on any device or distributed con…
959838stable
Tiiny-AI/PowerInfer
PowerInfer is a CPU/GPU hybrid LLM inference engine that exploits activation locality to run large language models fast on consumer-grade h…
639752active
NVIDIA/cudf
cuDF is a GPU-accelerated DataFrame library for tabular data processing, part of NVIDIA's RAPIDS suite. It provides a pandas-compatible Pyt…
959734stable
Oneflow-Inc/oneflow
OneFlow is an open-source deep learning framework written in C++ with a PyTorch-like Python API, focused on scalable and efficient distribu…
489428active
gyroflow/gyroflow
Gyroflow is an open-source, cross-platform application that stabilizes video using gyroscope (and optionally accelerometer) motion data log…
729366stable
CatBoost
CatBoost is an open-source gradient boosting on decision trees library developed by Yandex, offering high-quality classification, regressio…
859078stable
NVIDIA/apex
NVIDIA-maintained PyTorch extension providing utilities for easy mixed precision and distributed training. It offers up-to-date CUDA and C+…
778993active
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, quantizing, deploying, and serving large language models, built around its high-performance TurboMin…
958024active
TheLastBen/fast-stable-diffusion
A collection of Google Colab notebooks for quickly running Stable Diffusion UIs (AUTOMATIC1111, ComfyUI) and training DreamBooth models for…
577910active
deepseek-ai/DeepGEMM
DeepGEMM is a high-performance CUDA BLAS kernel library for NVIDIA tensor cores, providing FP8, FP4, and BF16 GEMMs plus fused MoE and othe…
847738active
kroma-network/tachyon
Tachyon is a modular zero-knowledge (ZK) proving backend written in C++17, designed to let developers implement arbitrary proving schemes w…
267655active
EmbarkStudios/rust-gpu
rust-gpu is a compiler toolchain that makes Rust a first-class language for writing GPU graphics and compute shaders, compiling Rust code t…
107568active
tile-ai/tilelang
TileLang is a Pythonic domain-specific language and compiler (built on TVM) for writing high-performance GPU/CPU/accelerator kernels such a…
887288active
NVIDIA/warp
NVIDIA Warp is a Python framework that JIT-compiles regular Python functions into efficient CPU or CUDA GPU kernels. It provides differenti…
987033active
halide/Halide
Halide is an embedded DSL (in C++ and Python) for writing high-performance, data-parallel image and array processing pipelines. It separate…
706590stable
linkedin/Liger-Kernel
Liger Kernel is a collection of Triton kernels designed to make LLM training faster and more memory-efficient, offering drop-in replacement…
906588active
kvcache-ai/Mooncake
Mooncake is a KVCache-centric disaggregated serving platform for LLM inference, originally built to serve Kimi by Moonshot AI. It separates…
916398active
drumih/turbo-fieldfare
TurboFieldfare is a custom Swift + Metal runtime that runs Gemma 4 26B-A4B inference in roughly 2 GB of RAM on Apple Silicon Macs by stream…
806397active
flashinfer-ai/flashinfer
FlashInfer is a GPU kernel library and kernel generator for LLM inference, providing unified APIs for attention, GEMM, and MoE operations w…
906252active
meta-pytorch/gpt-fast
A minimal (<1000 lines) PyTorch-native implementation of fast transformer text generation, demonstrating low-latency LLM inference with int…
446249active
LWJGL/lwjgl3
LWJGL 3 is a Java library providing cross-platform, high-performance bindings to native APIs such as OpenGL, Vulkan, OpenAL, OpenCL, and Op…
955435stable
NVIDIA/cuml
NVIDIA cuML is a GPU-accelerated machine learning library offering scikit-learn-style estimators that run on NVIDIA GPUs via CUDA. It also …
945264active
ProjectPhysX/FluidX3D
FluidX3D is a high-performance lattice Boltzmann method computational fluid dynamics (CFD) application written in C++/OpenCL. It runs on al…
905250active
NVIDIA/nccl
NVIDIA's Collective Communication Library (NCCL) is a C++ library providing topology-aware, high-bandwidth inter-GPU communication primitiv…
985027stable
ztxz16/fastllm
fastllm is a high-performance C++ LLM inference library with its own custom operators, requiring no PyTorch dependency. It supports tensor-…
744945active
spaceandtimefdn/blitzar
Blitzar is a C++ library (with Rust bindings) that accelerates zero-knowledge proof algorithms on CPU and GPU using CUDA. It was built by S…
894865active
openxla/xla
XLA (Accelerated Linear Algebra) is an open-source machine learning compiler that optimizes models from frameworks like PyTorch, TensorFlow…
774499active
st-tech/ppf-contact-solver
A GPU-accelerated contact solver for physics-based simulations of shells (cloth), solids, rods, rigid bodies, and sand, originally develope…
874446active
ROCm/hip
HIP is a C++ runtime API and kernel programming language for AMD GPUs that mirrors the NVIDIA CUDA programming interface. It enables develo…
954392active
AI4Finance-Foundation/ElegantRL
ElegantRL is a lightweight, modular deep reinforcement learning library built on PyTorch that implements core model-free RL algorithms (PPO…
534355active
uxlfoundation/oneDNN
oneDNN is an open-source cross-platform performance library providing optimized building blocks (primitives) for deep learning applications…
994042stable
armory3d/armorpaint
ArmorPaint is a stand-alone 3D PBR texture painting application that runs entirely on the GPU, supporting node-based procedural materials, …
674039active
AnswerDotAI/gpu.cpp
A lightweight, header-only C++20 library for portable low-level GPU compute built on Dawn's WebGPU implementation. It provides a minimal AP…
793984active
cornellius-gp/gpytorch
GPyTorch is a Gaussian process library built on PyTorch, designed for scalable, flexible, and modular GP models. It uses linear algebra tec…
823906stable
servo/pathfinder
Pathfinder 3 is a fast GPU-based rasterizer for fonts and vector graphics, usable from Rust or C/C++ via a canvas-like API. It supports Ope…
583896active
NVIDIA/k8s-device-plugin
NVIDIA's official Kubernetes device plugin that exposes NVIDIA GPUs as schedulable resources in Kubernetes clusters. It supports GPU sharin…
953859stable
PaddlePaddle/FastDeploy
FastDeploy is a high-performance inference and deployment toolkit for large language models and vision-language models built on PaddlePaddl…
883711active
thu-ml/SageAttention
SageAttention is a family of quantized attention kernels (INT8/FP8/FP4) that accelerate transformer inference 2-5x over FlashAttention with…
403684active
mmp/pbrt-v4
pbrt-v4 is the C++ physically based ray tracing system accompanying the fourth edition of the book 'Physically Based Rendering: From Theory…
713683stable
HazyResearch/ThunderKittens
ThunderKittens is a C++/CUDA framework of tile-based primitives for writing fast deep learning GPU kernels. It embeds natively into CUDA so…
703659active
mit-han-lab/llm-awq
AWQ is a Python library implementing Activation-aware Weight Quantization for compressing large language models to low-bit (INT3/4) weights…
443621active
holoviz/datashader
Datashader is a Python data rasterization pipeline that renders very large datasets into fixed-size images by projecting, aggregating, and …
893558active
NVIDIA/cuda-python
NVIDIA's official Python package for accessing the CUDA platform, providing Pythonic APIs and low-level bindings to CUDA C APIs, parallel a…
953359active
google-ai-edge/LiteRT
LiteRT is Google's successor to TensorFlow Lite, an on-device runtime for high-performance ML and GenAI inference on edge platforms. It pro…
853339active
determined-ai/determined
Determined is an open-source deep learning platform that combines distributed training, hyperparameter tuning, experiment tracking, and GPU…
393236active
facebook/igl
Facebook's Intermediate Graphics Library (IGL) is a cross-platform C++ library that provides a single low-level interface for commanding th…
713229active
orhun/ratty
Ratty is a GPU-rendered terminal emulator written in Rust with Ratatui that supports inline 3D graphics alongside traditional 2D terminal r…
783203active
Sergio0694/ComputeSharp
ComputeSharp is a .NET library that lets developers write compute and pixel shaders in C# and run them in parallel on the GPU via DirectX 1…
733161stable
software-mansion/TypeGPU
TypeGPU is a modular TypeScript toolkit for WebGPU that provides advanced type inference and lets developers write WGSL shaders directly in…
923102active
ikawrakow/ik_llama.cpp
A fork of llama.cpp offering state-of-the-art quantization types and improved CPU/CUDA inference performance for large language models. It …
593091active
PixarAnimationStudios/OpenSubdiv
OpenSubdiv is a set of open-source C++ libraries implementing high-performance subdivision surface evaluation on massively parallel CPU and…
763070stable
lammps/lammps
LAMMPS (Large-scale Atomic/Molecular Massively Parallel Simulator) is an open-source classical molecular dynamics simulation code focused o…
943029stable
deepseek-ai/DualPipe
DualPipe is a Python library implementing a bidirectional pipeline parallelism algorithm that overlaps forward and backward computation wit…
482998active
thu-pacman/chitu
Chitu (赤兔) is a high-performance inference framework for large language models, positioned as a production-grade LLM serving engine. It sup…
842995active
ispc/ispc
Intel ISPC is a compiler for a C-based SPMD (single program, multiple data) language that targets SIMD vector units on CPUs and GPUs. It le…
892945stable
leggedrobotics/rsl_rl
RSL-RL is a GPU-accelerated, lightweight reinforcement learning library for robotics research, featuring algorithms like PPO and Student-Te…
972916active
elixir-nx/nx
Nx is an Elixir library providing multi-dimensional arrays (tensors) and numerical definitions with pluggable backends. The monorepo also i…
982901active
Lolliedieb/lolMiner-releases
lolMiner is a closed-source GPU cryptocurrency miner for AMD, Nvidia, and Intel graphics cards supporting many proof-of-work algorithms suc…
562890active
diku-dk/futhark
Futhark is a purely functional, statically typed data-parallel array programming language in the ML family, developed at the University of …
952793active
Mega4alik/ollm
oLLM is a lightweight Python library for large-context LLM inference built on Hugging Face Transformers and PyTorch. It offloads weights an…
602788active
Luce-Org/lucebox
Lucebox is an open-source LLM inference engine written in C++ with custom CUDA/HIP kernels, focused on speculative decoding and speculative…
592788active
FasterDecoding/Medusa
Medusa is a framework that accelerates LLM text generation by adding multiple decoding heads to an existing model, avoiding the need for a …
182770active
RenderKit/embree
Intel Embree is a high-performance ray tracing kernel library providing optimized primitive intersection and acceleration structure constru…
802745stable
CVCUDA/CV-CUDA
CV-CUDA is an open-source GPU-accelerated library of computer vision and image processing operators built on CUDA, with C++ and Python APIs…
932718active
xdit-project/xDiT
xDiT is a scalable inference engine for Diffusion Transformers (DiTs) that enables parallel deployment across multiple GPUs and machines. I…
772699active
Const-me/Whisper
A Windows port of whisper.cpp that runs OpenAI's Whisper speech recognition model on the GPU via DirectCompute (Direct3D 11 compute shaders…
6010649maintenance
kokkos/kokkos
Kokkos Core is a C++ programming model providing abstractions for parallel execution and memory management to write performance-portable ap…
992649stable
meta-pytorch/torchrec
TorchRec is a PyTorch domain library for building recommendation systems at scale. It provides distributed sharding of large embedding tabl…
902599active
KomputeProject/kompute
Kompute is a general-purpose GPU compute framework built on Vulkan that works across vendor GPUs (AMD, NVIDIA, Qualcomm, etc.) with both C+…
662558active
SafeAILab/EAGLE
EAGLE is the official implementation of the EAGLE family of speculative decoding algorithms (EAGLE-1/2/3) for accelerating LLM text generat…
572510active
NVIDIA/cccl
CUDA Core Compute Libraries (CCCL) is NVIDIA's unified repository for Thrust, CUB, and libcudacxx, providing high-performance C++ abstracti…
982488active
pykeio/ort
ort is a safe, fast Rust binding for Microsoft's ONNX Runtime, providing hardware-accelerated machine learning inference and training for O…
892476active
mirage-project/mirage
Mirage Persistent Kernel (MPK) is a compiler and runtime that transforms multi-GPU LLM inference into a single fused megakernel, reducing i…
832452active
lupinemachines/lupine
LUPINE is a GPU-over-IP bridge that lets machines without local GPUs attach NVIDIA GPUs running on remote servers over the network. It expo…
892382active
FMInference/FlexLLMGen
FlexLLMGen is a high-throughput generation engine for running large language models on a single GPU with limited memory. It uses IO-efficie…
109352maintenance
idaholab/moose
MOOSE is a finite-element, multiphysics simulation framework developed by Idaho National Laboratory, built on top of PETSc's nonlinear solv…
772338stable
tracel-ai/cubecl
CubeCL is a Rust language extension, JIT compiler, and runtime set for writing high-performance GPU compute kernels in plain Rust. A single…
812334active

page 1 / 6 next →