Ross ROSS = Recommend OSS · open-source software intelligence for agents

domain: gpu-computing

395 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
NVIDIA/dcgm-exporter
NVIDIA's GPU metrics exporter for Prometheus, built on top of DCGM (Data Center GPU Manager). It exposes GPU telemetry such as clock speeds…
971844active
triple-mu/YOLOv8-TensorRT
A library for running YOLOv8 inference accelerated with NVIDIA TensorRT, supporting detection, segmentation, pose estimation, oriented boun…
751804active
NVlabs/curobo
cuRobo is a CUDA-accelerated Python library for robot motion generation built on PyTorch, CUDA, and Warp. It provides GPU-parallel algorith…
771794active
moderngpu/moderngpu
moderngpu is a header-only C++ productivity library for general-purpose GPU computing built on CUDA. It provides accelerated primitives for…
511789active
DTolm/VkFFT
VkFFT is an open-source, GPU-accelerated multidimensional Fast Fourier Transform library supporting Vulkan, CUDA, HIP, OpenCL, Level Zero, …
571769active
GPUOpen-LibrariesAndSDKs/FidelityFX-SDK
AMD's FidelityFX SDK (FSR SDK) is a collection of heavily optimized GPU techniques for DirectX 12 and Vulkan applications, including super …
841766active
webonnx/wonnx
Wonnx is a GPU-accelerated ONNX inference runtime written entirely in Rust, built on wgpu and usable natively or in the browser via WebGPU …
101754active
m4rs-mt/ILGPU
ILGPU is a just-in-time compiler for high-performance GPU programs (kernels) written in .NET languages like C# and F#, entirely in C# with …
681748active
rusty1s/pytorch_scatter
A PyTorch extension library providing highly optimized scatter and segment (sparse update) operations with sum, mean, min, and max reductio…
611745stable
deepseek-ai/TileKernels
TileKernels is a Python library of optimized GPU kernels for LLM operations, written in the TileLang DSL. It provides kernels for MoE routi…
491743active
0xSero/turboquant
TurboQuant is a Python library implementing near-optimal KV cache quantization for LLM inference, compressing keys to 3-bit and values to 2…
481739active
tile-ai/TileRT
TileRT is a tile-based runtime for ultra-low-latency LLM inference, achieving hundreds to over 1000 tokens/s decode speeds on frontier mode…
771738active
OpenNebula/one
OpenNebula is an open-source cloud management platform for building and operating private clouds, edge infrastructures, distributed deploym…
761736stable
Zaneham/Booth
Booth is an open-source compiler that takes CUDA C, HIP, or Triton kernel source and emits binaries for AMD RDNA 2/3/4 GPUs, NVIDIA PTX, Te…
771731active
NVIDIA/FasterTransformer
NVIDIA's highly optimized C++/CUDA library for fast inference of Transformer-based models such as BERT, GPT, and encoder-decoder models, wi…
236447maintenance
dealii/dealii
deal.II is a C++ library for solving partial differential equations using adaptive finite elements, with support for dimension-independent …
901715stable
google-research/circuit_training
AlphaChip (circuit_training) is Google's open-source framework for generating chip floorplans using distributed deep reinforcement learning…
621706active
chungmin99/pyroki
PyRoki is a modular Python toolkit for robot kinematic optimization built on JAX, providing differentiable forward kinematics from URDFs, c…
531682active
pyscf/pyscf
PySCF is a Python-based framework for quantum chemistry simulations, providing electronic structure methods such as Hartree-Fock, density f…
931658stable
tenstorrent/tt-metal
TT-Metal is Tenstorrent's open-source software stack containing TT-NN, a Python and C++ neural network operator library, and TT-Metalium, a…
971640active
NVIDIA/nccl-tests
NVIDIA's official test suite for NCCL that measures the performance and correctness of collective communication operations across GPUs. It …
761636active
NVIDIAGameWorks/rtx-remix
NVIDIA RTX Remix is an open-source platform for remastering classic DirectX 8/9 games with RTX path tracing, DLSS, and AI-upgraded textures…
811631active
mlcommons/inference
Reference implementations of the MLPerf Inference benchmark suite, the industry-standard benchmarks for measuring how fast ML systems run m…
831621active
psalias2006/gpu-hot
GPU Hot is a lightweight, self-hosted web dashboard for real-time NVIDIA GPU monitoring, deployed via a single Docker command. It polls NVM…
821621active
chainer/chainer
Chainer is a Python-based deep learning framework that pioneered the define-by-run approach with dynamic computational graphs and automatic…
235924maintenance
NVlabs/sionna
Sionna is an open-source, GPU-accelerated, differentiable Python library from NVIDIA for research on communication systems. It comprises Si…
831577active
Xilinx/brevitas
Brevitas is a PyTorch library for neural network quantization supporting both post-training quantization (PTQ) and quantization-aware train…
911567active
utkuozdemir/nvidia_gpu_exporter
A Prometheus exporter written in Go that collects NVIDIA GPU metrics by invoking the nvidia-smi binary or reading directly from the NVML dr…
981542active
RightNow-AI/autokernel
AutoKernel is an open-source autoresearch pipeline that takes any PyTorch model, profiles it to find GPU kernel bottlenecks, extracts them …
481535active
ByteDance-Seed/Triton-distributed
Triton-distributed is a distributed compiler built on OpenAI Triton for computation-communication overlapping on multi-GPU systems. It lets…
631526active
intel/llvm
Intel's staging area for LLVM upstream contributions and home for Intel LLVM-based projects, most notably the oneAPI DPC++ compiler impleme…
951517active
uccl-project/uccl
UCCL is a high-performance GPU communication library written in C++ that provides collectives (as a drop-in NCCL/RCCL replacement), P2P tra…
711496active
beehive-lab/TornadoVM
TornadoVM is a Java programming framework that JIT-compiles JVM bytecode into GPU kernels targeting NVIDIA CUDA, OpenCL, and Apple Metal at…
971491active
NVIDIA/MatX
MatX is a C++20 header-only numerical computing library providing NumPy-like tensor expressions for NVIDIA GPUs and multithreaded CPUs. It …
901444active
intel/compute-runtime
Intel's open-source Graphics Compute Runtime (NEO) providing OpenCL 3.0 and oneAPI Level Zero compute API support for Intel HD Graphics and…
951432active
JuliaGPU/CUDA.jl
CUDA.jl is the main Julia package for programming NVIDIA CUDA GPUs, offering a high-level CuArray abstraction, a compiler for writing CUDA …
991424stable
NVIDIA/gdrcopy
GDRCopy is a low-latency GPU memory copy library built on NVIDIA GPUDirect RDMA technology, allowing CPU-driven copies between host and GPU…
841412active
RahulSChand/gpu_poor
A web-based calculator that estimates GPU memory requirements and inference/finetuning throughput (token/s) for any LLM. It supports quanti…
181405active
NVIDIA/thrust
Thrust is a C++ parallel algorithms library providing an STL-like high-level interface for GPU and multicore CPU computing, built on CUDA, …
105002maintenance
NVIDIA-AI-IOT/torch2trt
torch2trt is a Python library that converts PyTorch models to TensorRT engines using the TensorRT Python API, with a simple single-function…
234878maintenance
jfalcou/eve
EVE is a C++20 header-only library providing a type-based, high-abstraction wrapper over SIMD instruction sets (SSE/AVX-512, NEON/SVE, Alti…
671360active
bytedance/flux
Flux is a GPU kernel library from ByteDance that overlaps computation with communication for tensor and expert parallelism in dense and MoE…
331354active
k2-fsa/k2
k2 is a C++/CUDA library with Python bindings that implements differentiable Finite State Automaton (FSA) and Finite State Transducer (FST)…
641352active
MegEngine/MegEngine
MegEngine is a fast, scalable deep learning framework with automatic differentiation, developed in C++ with Python bindings. It unifies tra…
234808maintenance
KratosMultiphysics/Kratos
Kratos Multiphysics is a C++ framework with an extensive Python interface for building parallel, multi-disciplinary simulation software suc…
921329active
facebookincubator/AITemplate
AITemplate is a Python framework that compiles deep neural networks into high-performance CUDA (NVIDIA) or HIP (AMD) C++ code for fast fp16…
664724maintenance
LuxCoreRender/LuxCore
LuxCoreRender is a physically based, unbiased rendering engine with a C++ and Python API (LuxCore), supporting CPU, OpenCL, CUDA, and OptiX…
921321active
alibaba/rtp-llm
RTP-LLM is Alibaba's high-performance LLM inference engine written in C++/CUDA, optimized with kernels like PagedAttention and FlashAttenti…
661316active
turboderp-org/exllamav2
ExLlamaV2 is a fast Python inference library for running large language models locally on modern consumer GPUs, with support for EXL2/GPTQ …
614611maintenance
nvidia-isaac/nvblox
nvblox is a GPU-accelerated C++/Python library for real-time 3D reconstruction using TSDF and ESDF volumetric mapping, designed for robots …
851276active
TheRock
TheRock is AMD's open-source build and release system for the ROCm software stack, replacing the legacy monolithic ROCm release process wit…
891270active
stotko/stdgpu
stdgpu is a lightweight C++17 library providing STL-like generic data structures (vector, unordered_map, unordered_set, deque, queue, stack…
641270active
vipshop/cache-dit
Cache-DiT is a PyTorch-native inference engine that accelerates Diffusion Transformer (DiT) models with hybrid caching, parallelism, quanti…
821267active
BytedTsinghua-SIA/CUDA-Agent
CUDA-Agent is a large-scale agentic reinforcement learning system from ByteDance Seed and Tsinghua that trains LLMs to generate high-perfor…
561256active
dmlc/dlpack
DLPack is a minimal, stable open in-memory tensor structure defined as a single C ABI header, enabling zero-copy tensor exchange between de…
661242stable
MoonshotAI/FlashKDA
FlashKDA is a set of high-performance CUDA kernels (built on CUTLASS) implementing Kimi Delta Attention, a linear attention mechanism, for …
571229active
microsoft/MInference
MInference is a Microsoft library that accelerates long-context LLM inference using dynamic sparse attention, reducing pre-fill latency by …
491226active
chelsea0x3b/cudarc
cudarc is a safe, minimal Rust wrapper around the NVIDIA CUDA toolkit, exposing the CUDA driver API plus libraries such as NVRTC, cuBLAS/cu…
981213active
getkeops/keops
KeOps (pykeops) is a Python library for computing kernel reductions over large arrays on CPUs and GPUs using efficient C++/CUDA routines wi…
651189active
CNugteren/CLBlast
CLBlast is a lightweight, tunable OpenCL BLAS library written in C++11 that implements basic linear algebra subprograms for vectors and mat…
701186stable
Linaom1214/TensorRT-For-YOLO-Series
A Python and C++ toolkit for running YOLO-series object detection models (YOLOv3 through YOLOv12, YOLOX) with NVIDIA TensorRT, including ON…
441162active
inducer/pyopencl
PyOpenCL is a Python wrapper providing Pythonic access to the OpenCL parallel computation API, letting you run kernels on GPUs and other ma…
991149stable
extropic-ai/thrml
THRML is a JAX library for building and sampling probabilistic graphical models, focused on efficient block Gibbs sampling of energy-based …
711144active
ovg-project/kvcached
kvcached is a Python library that brings OS-style virtual memory abstraction to KV cache management for LLM serving and training on shared …
741143active
IST-DASLab/marlin
Marlin is a highly optimized FP16xINT4 matrix multiplication CUDA kernel for LLM inference that achieves near-ideal 4x speedups at batch si…
261136active
Dao-AILab/quack
QuACK is a collection of high-performance GPU kernels (RMSNorm, LayerNorm, softmax, cross-entropy, GEMM with epilogues) written in NVIDIA's…
851135active
Tencent/hpc-ops
HPC-Ops is a production-grade C++/CUDA operator library for high-performance LLM inference, developed by Tencent's Hunyuan AI Infra team. I…
591131active
NVIDIA/cuda-quantum
NVIDIA's CUDA-Q platform providing C++ and Python tools for programming heterogeneous quantum-classical workflows across QPUs, GPUs, and CP…
911124active
NVIDIA/libnvidia-container
A C library and CLI utility (nvidia-container-cli) that automatically configures GNU/Linux containers to leverage NVIDIA hardware, relying …
951123stable
gunrock/gunrock
Gunrock is a CUDA/C++ library for GPU-accelerated graph analytics built on a high-level, data-centric abstraction over vertex and edge fron…
631095active
bytedance/byteps
BytePS is a high-performance parameter server framework for distributed deep neural network training, supporting TensorFlow, Keras, PyTorch…
103717maintenance
pocl/pocl
PoCL (Portable Computing Language) is an MIT-licensed, conformant open-source implementation of the OpenCL 3.0 standard that can be easily …
741075active
NVIDIA-Merlin/HugeCTR
HugeCTR is a GPU-accelerated deep learning framework from NVIDIA designed for training and inference of large recommender models, especiall…
771071active
neka-nat/cupoch
Cupoch is a C++/Python library that implements rapid 3D data processing for robotics using CUDA, based on Open3D. It provides GPU-accelerat…
631061active
zhuzilin/ring-flash-attention
A Python library implementing RingAttention on top of FlashAttention for distributed long-context transformer training. It provides varlen …
441049active
LuisaGroup/LuisaCompute
LuisaCompute is a high-performance cross-platform computing framework for graphics and beyond, featuring a C++-embedded DSL for GPU kernel …
771043active
brichard19/BitCrack
BitCrack is a C++ command-line tool for brute-forcing Bitcoin private keys using CUDA (NVIDIA) or OpenCL (AMD/Intel) GPU acceleration. It w…
231042active
NVIDIA/raft
NVIDIA RAFT (Reusable Accelerated Functions and Tools) is a C++/Python library of CUDA-accelerated algorithms and primitives for machine le…
941038active
thu-ml/SpargeAttn
SpargeAttn is the official implementation of a training-free sparse and quantized attention method that accelerates inference for language,…
511033active
NVIDIA/cuopt
NVIDIA cuOpt is a GPU-accelerated optimization engine for linear programming, quadratic programming, mixed integer programming, and vehicle…
821032active
Bend
Bend is a high-level, massively parallel programming language that feels like Python or Haskell but automatically parallelizes programs acr…
6919808experimental
AccelerateHS/accelerate
Accelerate is an embedded domain-specific language in Haskell for high-performance, multi-dimensional array computations. Programs written …
621018active
NVIDIA/cuda-tile
CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for optimizing CUDA kernels with tile-based computati…
821015active
pytorch/glow
Glow is a machine learning compiler and execution engine for neural network hardware accelerators, developed under the PyTorch project. It …
103320maintenance
bytedance/lightseq
LightSeq is a high-performance CUDA-based library for training and inference of sequence models like Transformer, BERT, GPT, and BART, with…
103295maintenance
NebuTech/NBMiner
NBMiner is a closed-source GPU cryptocurrency miner supporting algorithms like ethash, etchash, kawpow, cuckoo_ae, beamv3, octopus, and erg…
233178maintenance
qwopqwop200/GPTQ-for-LLaMa
A Python library that applies GPTQ 4-bit weight quantization to LLaMA large language models, drastically reducing memory usage and checkpoi…
303073maintenance
shouxieai/tensorRT_Pro
A C++ library built on NVIDIA TensorRT that provides a high-level interface for high-performance deep learning inference, with Python bindi…
232892maintenance
cybertronai/gradient-checkpointing
A Python library that reduces GPU memory usage when training very deep neural networks via gradient checkpointing, trading computation for …
322843maintenance
microsoft/pai
OpenPAI is an open-source AI platform from Microsoft that provides resource scheduling and cluster management for machine learning workload…
662688maintenance
turbo/js
turbo.js is a small JavaScript library for GPGPU computing in the browser, letting you run parallel kernels written in GLSL over large Floa…
102654maintenance
trexminer/T-Rex
T-Rex is a closed-source NVIDIA GPU cryptocurrency miner supporting algorithms like Ethash, Etchash, Autolykos2, Kawpow, and Octopus, with …
232641maintenance
microsoft/DirectML
DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning that provides GPU acceleration across DirectX …
582580maintenance
GPUOpen-Effects/FidelityFX-FSR
AMD FidelityFX Super Resolution (FSR 1.0) is an open-source spatial upscaling solution that produces high-resolution frames from lower-reso…
232180maintenance
BlazingDB/blazingsql
BlazingSQL is a GPU-accelerated distributed SQL engine for Python, built on the RAPIDS ecosystem and cuDF GPU DataFrames. It lets users run…
232011maintenance
google/TensorNetwork
TensorNetwork is a Python library for building and contracting tensor networks, with backends for TensorFlow, JAX, PyTorch, and NumPy. It p…
101870maintenance
NVIDIA/cub
CUB is a header-only C++ library providing reusable cooperative primitives (sort, scan, reduction, histogram) for device-wide, block-wide, …
101842maintenance
OpenPPL/ppq
PPQ (PPL Quantization Tool) is an extensible, high-performance offline neural network quantization framework written in Python. It parses a…
231816maintenance
jkjung-avt/tensorrt_demos
A collection of Python demo programs showing how to optimize and run deep learning models (YOLOv4, YOLOv3, SSD, MTCNN, GoogLeNet, MODNet) w…
501792maintenance
facebookresearch/TensorComprehensions
Tensor Comprehensions is a C++ library with a Python API that provides a domain-specific language for expressing machine learning workloads…
101767maintenance

← prev page 2 / 4 next →