Ross ROSS = Recommend OSS · open-source software intelligence for agents

domain: gpu-computing

395 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
jax-ml/jax
JAX is a Python library for accelerator-oriented array computation and composable program transformations, offering NumPy-compatible APIs w…
9936215stable
Taichi
Taichi Lang is an open-source domain-specific language embedded in Python for high-performance parallel numerical computation, using a JIT …
6428345active
hashcat
Hashcat is the world's fastest and most advanced password recovery utility, supporting over 300 highly-optimized hashing algorithms across …
8026631active
Dao-AILab/flash-attention
Official implementation of FlashAttention, FlashAttention-2, -3, and -4: fast and memory-efficient exact attention kernels for GPUs. It acc…
9524787active
mlc-ai/mlc-llm
MLC LLM is a machine learning compiler and high-performance deployment engine for large language models, built on TVM-based ML compilation.…
6423095active
triton-lang/triton
Triton is an open-source language and compiler for writing highly efficient custom deep-learning GPU kernels with Python-level productivity…
9220017active
NVIDIA/open-gpu-kernel-modules
The source release of NVIDIA's open Linux GPU kernel modules, released per driver version and built with make. It must be paired with match…
9317320active
tracel-ai/burn
Burn is a Rust-based tensor library and deep learning framework supporting training and inference through a unified API. It JIT-compiles te…
8915816active
gpujs/gpu.js
GPU.js is a JavaScript acceleration library for GPGPU that automatically transpiles JavaScript functions into shader language (GLSL) and co…
9715370active
vosen/ZLUDA
ZLUDA is a drop-in replacement layer for CUDA that lets unmodified CUDA applications run on non-NVIDIA GPUs with near-native performance. I…
8514777active
NVIDIA/TensorRT-LLM
NVIDIA's TensorRT-LLM is a Python library and runtime for defining and serving Large Language Models with state-of-the-art inference optimi…
8414483active
Eclipse Deeplearning4J
Eclipse Deeplearning4J is an open-source deep learning framework and ecosystem for the JVM, including the ND4J linear algebra library, the …
7714246active
NVIDIA/TensorRT
NVIDIA TensorRT is an SDK for high-performance deep learning inference on NVIDIA GPUs, comprising an inference compiler that converts train…
9413293stable
deepseek-ai/FlashMLA
FlashMLA is DeepSeek's library of optimized CUDA attention kernels implementing Multi-head Latent Attention (MLA), including dense and toke…
6212872active
cupy/cupy
CuPy is a NumPy/SciPy-compatible array library for GPU-accelerated computing with Python, running on NVIDIA CUDA or AMD ROCm. It acts as a …
9512278stable
taskflow/taskflow
Taskflow is a header-only C++ library for building task-parallel programs using task dependency graphs, with a work-stealing executor for C…
8612126stable
Numba
Numba is an open-source NumPy-aware JIT compiler that translates a subset of Python and NumPy code into fast machine code using LLVM. It su…
9411129stable
Syllo/nvtop
NVTOP is an htop-like ncurses task monitor for GPUs and AI accelerators, supporting NVIDIA, AMD, Intel, Apple, Huawei Ascend, Qualcomm Adre…
8110941active
cumulo-autumn/StreamDiffusion
StreamDiffusion is a Python pipeline for real-time interactive diffusion-based image generation, achieving 100+ fps on modern GPUs. It opti…
1710806active
NVIDIA/cutlass
CUTLASS is NVIDIA's collection of CUDA C++ template abstractions and Python DSLs for implementing high-performance GEMM and related linear …
9910317active
Tiiny-AI/PowerInfer
PowerInfer is a CPU/GPU hybrid LLM inference engine that exploits activation locality to run large language models fast on consumer-grade h…
639752active
NVIDIA/cudf
cuDF is a GPU-accelerated DataFrame library for tabular data processing, part of NVIDIA's RAPIDS suite. It provides a pandas-compatible Pyt…
959734stable
Oneflow-Inc/oneflow
OneFlow is an open-source deep learning framework written in C++ with a PyTorch-like Python API, focused on scalable and efficient distribu…
489428active
NVIDIA/apex
NVIDIA-maintained PyTorch extension providing utilities for easy mixed precision and distributed training. It offers up-to-date CUDA and C+…
778993active
zeux/meshoptimizer
A C/C++ library providing algorithms to optimize triangle meshes for GPU rendering, including vertex cache optimization, overdraw reduction…
888268stable
ai-dynamo/dynamo
NVIDIA Dynamo is an open-source, datacenter-scale distributed inference serving framework that orchestrates inference engines like vLLM, SG…
877872active
deepseek-ai/DeepGEMM
DeepGEMM is a high-performance CUDA BLAS kernel library for NVIDIA tensor cores, providing FP8, FP4, and BF16 GEMMs plus fused MoE and othe…
847738active
kroma-network/tachyon
Tachyon is a modular zero-knowledge (ZK) proving backend written in C++17, designed to let developers implement arbitrary proving schemes w…
267655active
tile-ai/tilelang
TileLang is a Pythonic domain-specific language and compiler (built on TVM) for writing high-performance GPU/CPU/accelerator kernels such a…
887288active
XuehaiPan/nvitop
nvitop is an interactive NVIDIA GPU process viewer and monitoring tool built on NVML, offering a richer alternative to nvidia-smi with an h…
907123active
linkedin/Liger-Kernel
Liger Kernel is a collection of Triton kernels designed to make LLM training faster and more memory-efficient, offering drop-in replacement…
906588active
PufferAI/PufferLib
PufferLib is a fast, open-source reinforcement learning library that trains tiny, super-human models in seconds, achieving 1M+ environment …
816306active
flashinfer-ai/flashinfer
FlashInfer is a GPU kernel library and kernel generator for LLM inference, providing unified APIs for attention, GEMM, and MoE operations w…
906252active
shader-slang/slang
Slang is a shading language and compiler for building large, modular, high-performance GPU shader codebases. It compiles to D3D12, Vulkan, …
955580active
gpustack/gpustack
GPUStack is an open-source GPU cluster manager for AI model serving that orchestrates inference engines like vLLM, SGLang, and TensorRT-LLM…
905560active
newton-physics/newton
Newton is an open-source, GPU-accelerated physics simulation engine built on NVIDIA Warp, targeting roboticists and simulation researchers.…
865539active
NVIDIA/cuml
NVIDIA cuML is a GPU-accelerated machine learning library offering scikit-learn-style estimators that run on NVIDIA GPUs via CUDA. It also …
945264active
ProjectPhysX/FluidX3D
FluidX3D is a high-performance lattice Boltzmann method computational fluid dynamics (CFD) application written in C++/OpenCL. It runs on al…
905250active
NVIDIA/nccl
NVIDIA's Collective Communication Library (NCCL) is a C++ library providing topology-aware, high-bandwidth inter-GPU communication primitiv…
985027stable
arrayfire/arrayfire
ArrayFire is a general-purpose tensor/numerical computing library for C, C++, and Python that accelerates array operations on GPUs (CUDA, O…
574902stable
spaceandtimefdn/blitzar
Blitzar is a C++ library (with Rust bindings) that accelerates zero-knowledge proof algorithms on CPU and GPU using CUDA. It was built by S…
894865active
openxla/xla
XLA (Accelerated Linear Algebra) is an open-source machine learning compiler that optimizes models from frameworks like PyTorch, TensorFlow…
774499active
st-tech/ppf-contact-solver
A GPU-accelerated contact solver for physics-based simulations of shells (cloth), solids, rods, rigid bodies, and sand, originally develope…
874446active
Project-HAMi/HAMi
HAMi (Heterogeneous AI Computing Virtualization Middleware) is a CNCF Incubating, Kubernetes-native GPU virtualization and scheduling middl…
954438active
ROCm/hip
HIP is a C++ runtime API and kernel programming language for AMD GPUs that mirrors the NVIDIA CUDA programming interface. It enables develo…
954392active
wookayin/gpustat
gpustat is a simple command-line utility for querying and monitoring NVIDIA GPU status, offering a compact alternative to nvidia-smi. It di…
614392active
llm-d/llm-d
llm-d is a Kubernetes-native distributed LLM inference serving stack that orchestrates model servers like vLLM and SGLang across clusters. …
824164active
danveloper/flash-moe
An application for running large language models locally on small laptops, written in Objective-C. It enables on-device inference of big mo…
484086active
uxlfoundation/oneDNN
oneDNN is an open-source cross-platform performance library providing optimized building blocks (primitives) for deep learning applications…
994042stable
zml/zml
ZML is a production LLM inference stack written in Zig, built on MLIR and OpenXLA, that compiles models to run at peak performance across N…
724003active
AnswerDotAI/gpu.cpp
A lightweight, header-only C++20 library for portable low-level GPU compute built on Dawn's WebGPU implementation. It provides a minimal AP…
793984active
NVIDIA/k8s-device-plugin
NVIDIA's official Kubernetes device plugin that exposes NVIDIA GPUs as schedulable resources in Kubernetes clusters. It supports GPU sharin…
953859stable
thu-ml/SageAttention
SageAttention is a family of quantized attention kernels (INT8/FP8/FP4) that accelerate transformer inference 2-5x over FlashAttention with…
403684active
HazyResearch/ThunderKittens
ThunderKittens is a C++/CUDA framework of tile-based primitives for writing fast deep learning GPU kernels. It embeds natively into CUDA so…
703659active
thu-ml/TurboDiffusion
TurboDiffusion is a Python framework that accelerates end-to-end video diffusion model generation by 100-200x using SageAttention, Sparse-L…
593623active
mit-han-lab/llm-awq
AWQ is a Python library implementing Activation-aware Weight Quantization for compressing large language models to low-bit (INT3/4) weights…
443621active
NVIDIA/cuda-python
NVIDIA's official Python package for accessing the CUDA platform, providing Pythonic APIs and low-level bindings to CUDA C APIs, parallel a…
953359active
onnx/onnx-tensorrt
A C++ parser library and backend that converts ONNX models into TensorRT engines for high-performance GPU inference. It is maintained by NV…
923228active
Sergio0694/ComputeSharp
ComputeSharp is a .NET library that lets developers write compute and pixel shaders in C# and run them in parallel on the GPU via DirectX 1…
733161stable
software-mansion/TypeGPU
TypeGPU is a modular TypeScript toolkit for WebGPU that provides advanced type inference and lets developers write WGSL shaders directly in…
923102active
BinomialLLC/basis_universal
Basis Universal is an open-source LDR/HDR GPU supercompressed texture codec and transcoding system supporting .KTX2 and .basis file formats…
963088active
pytorch/TensorRT
Torch-TensorRT is a compiler library that accelerates PyTorch model inference on NVIDIA GPUs using TensorRT. It supports just-in-time compi…
942986active
turboderp/exllama
ExLlama is a standalone Python/C++/CUDA implementation of the Llama architecture optimized for running 4-bit GPTQ quantized weights on mode…
292936active
elixir-nx/nx
Nx is an Elixir library providing multi-dimensional arrays (tensors) and numerical definitions with pluggable backends. The monorepo also i…
982901active
TheHPXProject/hpx
HPX is a C++ Standard Library for parallelism and concurrency that implements C++ standard parallel facilities and extends them to distribu…
672885stable
pytorch/xla
PyTorch/XLA is a Python package that connects the PyTorch deep learning framework to XLA devices such as Google Cloud TPUs via the XLA deep…
692803active
diku-dk/futhark
Futhark is a purely functional, statically typed data-parallel array programming language in the ML family, developed at the University of …
952793active
Luce-Org/lucebox
Lucebox is an open-source LLM inference engine written in C++ with custom CUDA/HIP kernels, focused on speculative decoding and speculative…
592788active
CVCUDA/CV-CUDA
CV-CUDA is an open-source GPU-accelerated library of computer vision and image processing operators built on CUDA, with C++ and Python APIs…
932718active
vllm-project/vllm-ascend
vllm-ascend is a community-maintained hardware plugin that enables vLLM to run large language model inference on Huawei Ascend NPUs. It imp…
832711active
xdit-project/xDiT
xDiT is a scalable inference engine for Diffusion Transformers (DiTs) that enables parallel deployment across multiple GPUs and machines. I…
772699active
qualcomm/aimet
AIMET (AI Model Efficiency Toolkit) is a Python library from Qualcomm providing advanced quantization and compression techniques for traine…
992688active
kokkos/kokkos
Kokkos Core is a C++ programming model providing abstractions for parallel execution and memory management to write performance-portable ap…
992649stable
open-mpi/ompi
Open MPI is an open-source, standards-conformant implementation of the Message Passing Interface (MPI) for high-performance computing, deve…
772633stable
meta-pytorch/torchrec
TorchRec is a PyTorch domain library for building recommendation systems at scale. It provides distributed sharding of large embedding tabl…
902599active
NVlabs/LongLive
LongLive is an NVIDIA research framework providing parallel training and inference infrastructure for real-time long video generation, usin…
602563active
KomputeProject/kompute
Kompute is a general-purpose GPU compute framework built on Vulkan that works across vendor GPUs (AMD, NVIDIA, Qualcomm, etc.) with both C+…
662558active
NVIDIA/cccl
CUDA Core Compute Libraries (CCCL) is NVIDIA's unified repository for Thrust, CUB, and libcudacxx, providing high-performance C++ abstracti…
982488active
mirage-project/mirage
Mirage Persistent Kernel (MPK) is a compiler and runtime that transforms multi-GPU LLM inference into a single fused megakernel, reducing i…
832452active
lupinemachines/lupine
LUPINE is a GPU-over-IP bridge that lets machines without local GPUs attach NVIDIA GPUs running on remote servers over the network. It expo…
892382active
tracel-ai/cubecl
CubeCL is a Rust language extension, JIT compiler, and runtime set for writing high-performance GPU compute kernels in plain Rust. A single…
812334active
openlake-project/openlake
OpenLake is a high-performance distributed storage engine written in Rust (built on io_uring, RDMA, and GPUDirect) designed to feed GPUs du…
812330active
666DZY666/micronet
micronet is a Python library for deep neural network model compression and deployment built on PyTorch. It provides quantization (QAT, PTQ,…
412266active
mfem/mfem
MFEM is a lightweight, modular C++ library for finite element discretization of PDEs, supporting arbitrary high-order element spaces, adapt…
742226stable
vortexgpgpu/vortex
Vortex is a full-stack open-source RISC-V GPGPU supporting OpenCL, with configurable cores, warps, and threads, plus graphics and tensor co…
812220active
NVIDIA/cutile-python
cuTile Python is a tile-based programming language and library from NVIDIA for writing parallel kernels that run on NVIDIA GPUs, compiling …
632137active
cvxpy/cvxpylayers
CVXPYlayers is a Python library for constructing differentiable convex optimization layers in PyTorch, JAX, and MLX using CVXPY. It solves …
872126active
PKU-YuanGroup/Helios
Helios is a 14B autoregressive diffusion model for real-time, minute-scale video generation supporting text-to-video, image-to-video, and v…
592076active
GPUOpen-Effects/FidelityFX-FSR2
AMD FidelityFX Super Resolution 2 (FSR 2) is an open-source, high-quality temporal upscaling solution that reconstructs high-resolution fra…
232073stable
inducer/pycuda
PyCUDA is a Python wrapper giving Pythonic access to Nvidia's CUDA parallel computation API, including GPUArray multidimensional arrays and…
782051active
NUS-HPC-AI-Lab/VideoSys
VideoSys is an open-source Python library providing easy and efficient infrastructure for video generation, supporting training, inference,…
452022active
chapel-lang/chapel
Chapel is a modern open-source programming language designed for productive parallel computing at scale, with first-class support for task …
872017active
lightseekorg/tokenspeed
TokenSpeed is a high-performance LLM inference engine designed for agentic workloads, aiming for TensorRT-LLM-level performance with vLLM-l…
681989active
NVIDIA/Stable-Diffusion-WebUI-TensorRT
An NVIDIA extension for the Stable Diffusion Web UI (Automatic1111) that accelerates image generation using TensorRT-optimized engines on R…
181989active
develsoftware/GMinerRelease
GMiner is a closed-source GPU cryptocurrency miner for NVIDIA and AMD cards supporting algorithms such as Ethash, ProgPoW, KAWPOW, Equihash…
671981active
siliconflow/onediff
OneDiff is an out-of-the-box acceleration library for diffusion models, providing PyTorch compilation tools and optimized GPU kernels. It i…
481964active
AdaptiveCpp/AdaptiveCpp
AdaptiveCpp (formerly hipSYCL/Open SYCL) is an independent, community-driven C++ compiler platform for heterogeneous programming models inc…
751928active
flexflow/flexflow-train
FlexFlow Train is a deep learning framework that accelerates distributed DNN training by automatically searching for efficient parallelizat…
671898active
kyuz0/amd-strix-halo-toolboxes
A collection of pre-built Toolbx/Docker containers ('toolboxes') for running llama.cpp LLM inference on AMD Ryzen AI Max 'Strix Halo' integ…
621881active
rednote-machine-learning/RedKnot
RedKnot is a long-context LLM inference acceleration library built on SGLang, using head-classified KV reuse, offline KV storage with RoPE …
581880active

page 1 / 4 next →