Ross ROSS = Recommend OSS · open-source software intelligence for agents

domain: gpu-computing

395 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
gpgpu-sim/gpgpu-sim_distribution
GPGPU-Sim is a cycle-level simulator that models contemporary NVIDIA GPUs running CUDA and OpenCL workloads, including support for TensorCo…
371701maintenance
boostorg/compute
Boost.Compute is a C++ GPU/parallel-computing library built on OpenCL, providing a thin C++ wrapper over the OpenCL API plus an STL-like in…
761660maintenance
calebwin/emu
Emu is a Rust GPGPU library providing a CUDA-like compute-focused abstraction over WebGPU. It offers type-safe GPU data boxing, an auto-man…
321604maintenance
AliyunContainerService/gpushare-scheduler-extender
A Kubernetes scheduler extender that enables multiple pods to share the same NVIDIA GPU device, increasing GPU utilization for inference an…
321532maintenance
mit-han-lab/proxylessnas
ProxylessNAS is a neural architecture search (NAS) framework that directly searches CNN architectures on the target task and target hardwar…
321447maintenance
VictorTaelin/WebMonkeys
A JavaScript library that lets you spawn thousands of parallel tasks on the GPU through a minimal set/get/work API, using GLSL 1.0 without …
321444maintenance
VerticalResearchGroup/miaow
MIAOW is an open source GPU implementation of the AMD Southern Islands ISA written in Verilog. It was developed as a research project at th…
391406maintenance
NVIDIA/VideoProcessingFramework
NVIDIA's Video Processing Framework (VPF) provides C++ libraries with Python bindings for fully hardware-accelerated video decoding, encodi…
101378maintenance
anderskm/gputil
GPUtil is a Python module that queries NVIDIA GPU status (memory usage, load, availability) by wrapping the nvidia-smi command-line tool. I…
651214maintenance
enazoe/yolo-tensorrt
A C++ wrapper around NVIDIA TensorRT for running YOLO object detection models (YOLOv3, YOLOv4, YOLOv5) with support for FP32, FP16, and INT…
571202maintenance
ROCm/MIOpen
MIOpen is AMD's open-source library providing high-performance GPU kernels for machine learning primitives (convolutions, normalization, ac…
931193maintenance
VoltaML/voltaML
VoltaML is a lightweight Python library that compiles and optimizes machine learning and deep learning models for high-performance inferenc…
321176maintenance
punica-ai/punica
Punica is a Python system for serving many LoRA-finetuned LLMs from a single copy of the base model on one GPU, using a custom CUDA kernel …
191175maintenance
Rust-GPU/rust-cuda
An ecosystem of Rust libraries and tools for writing and executing fast GPU code fully in Rust, targeting NVIDIA CUDA. It lets developers a…
675330experimental
NVIDIA-Merlin/NVTabular
NVTabular is a GPU-accelerated feature engineering and preprocessing library for tabular data, built to handle terabyte-scale datasets for …
601150maintenance
baidu-research/DeepBench
DeepBench is a benchmarking suite from Baidu Research that measures the performance of fundamental deep learning operations (matrix multipl…
321106maintenance
GPUOpen-LibrariesAndSDKs/RadeonRays_SDK
RadeonRays is a ray intersection acceleration library developed by AMD, providing a C API for scene building and asynchronous ray intersect…
231099maintenance
openai/blocksparse
A Python package of TensorFlow ops and custom CUDA GPU kernels for block-sparse matrix multiplication and convolution, plus related ops lik…
101068maintenance
NVlabs/cuda-oxide
cuda-oxide is an experimental rustc codegen backend that compiles Rust GPU kernels directly to CUDA PTX, letting you write SIMT device code…
773097experimental
NVIDIA/stdexec
stdexec is NVIDIA's reference implementation of std::execution, the C++26 standard framework for asynchronous and parallel programming base…
772417experimental
chelsea0x3b/dfdx
A Rust deep learning library providing shape-checked tensors and neural network building blocks with compile-time verification of tensor op…
231932experimental
hughperkins/VeriGPU
VeriGPU is an open-source GPU written in SystemVerilog, loosely based on the RISC-V ISA and targeting eventual ASIC tape-out for machine le…
321364experimental
tspeterkim/flash-attention-minimal
A minimal ~100-line CUDA re-implementation of the Flash Attention forward pass, loadable as a PyTorch extension. It is designed as an educa…
251179experimental
huggingface/optimum-nvidia
Optimum-NVIDIA is a Python library that bridges Hugging Face Transformers with NVIDIA TensorRT-LLM for highly optimized LLM inference on NV…
581037experimental
NervanaSystems/neon
neon was Intel Nervana's reference deep learning framework in Python, focused on best-in-class training performance on CPUs, GPUs, and Nerv…
103861abandoned
NVIDIA/libcudacxx
NVIDIA's libcudacxx is a C++ Standard Library implementation designed to work across both host CPUs and NVIDIA GPUs, providing standard-con…
102301abandoned
openai/sparse_attention
A Python library of sparse attention primitives from OpenAI's Sparse Transformers paper, including fused normal attention and strided/fixed…
101613abandoned
ELS-RD/kernl
Kernl is an open-source PyTorch model optimization library that accelerates transformer inference on GPUs with a single line of code, using…
101584abandoned
ivan-vasilev/neuralnetworks
A Java library implementing deep learning algorithms and deep neural network architectures (MLPs, CNNs, RBMs, autoencoders, DBNs) with GPU …
231236abandoned
eholk/harlan
Harlan is a small domain-specific language implemented in Scheme for programming GPUs, compiled to OpenCL. It serves primarily as a researc…
321192abandoned
hannes-brt/hebel
Hebel is a GPU-accelerated deep learning library in Python built on PyCUDA, implementing feed-forward neural networks for classification an…
231169abandoned
antonmks/Alenka
Alenka is a GPU-based column-store database engine written in CUDA that leverages vectorized processing and GPU memory bandwidth for fast a…
321167abandoned
NVIDIA/tensorflow
NVIDIA's fork of TensorFlow 1.15 providing GPU support for newer NVIDIA hardware and CUDA libraries after Google stopped maintaining the TF…
101149abandoned
dmlc/minpy
MinPy is a Python library providing a pure NumPy interface backed by MXNet, automatically dispatching operators to GPU when available and f…
101094abandoned
NervanaSystems/maxas
MaxAs is an assembler for NVIDIA Maxwell GPU architecture that assembles SASS (Shader Assembly) instructions, written in Perl. It enables l…
101074abandoned
NVIDIA/gpu-monitoring-tools
A deprecated NVIDIA repository containing Go bindings for NVML and DCGM plus the DCGM-Exporter for exposing GPU metrics to Prometheus in Ku…
101074abandoned
GPUOpen-Archive/CodeXL
CodeXL is AMD's open-source GPU tool suite offering GPU debugging, profiling, and static kernel/shader analysis for OpenCL, OpenGL, Vulkan,…
101009abandoned
pytorch/pytorch
PyTorch is a Python library providing NumPy-like tensor computation with strong GPU acceleration and a tape-based automatic differentiation…
93102605stable
DeepSpeed
DeepSpeed is a deep learning optimization library from Microsoft that makes distributed training and inference of large models fast, memory…
9843003stable
hpcaitech/ColossalAI
Colossal-AI is an integrated large-scale deep learning training system built on PyTorch that provides efficient parallelization techniques …
7441441active
tinygrad/tinygrad
tinygrad is a small, hackable deep learning framework providing a PyTorch-like tensor library with autograd, plus a visible IR and compiler…
9133509active
SGLang
SGLang is a high-performance open-source serving framework for large language models and multimodal models, offering low-latency, high-thro…
9332504stable
karpathy/llm.c
llm.c is a pure C/CUDA implementation for training large language models like GPT-2 and GPT-3, with no dependency on PyTorch or Python. It …
3730879active
Genesis-Embodied-AI/genesis-world
Genesis World is a Python simulation platform for physical AI and robotics that combines a unified multi-physics engine, a photorealistic r…
9329809active
modular/modular
Modular Platform hosting the MAX AI serving framework and the Mojo systems programming language. It provides an OpenAI-compatible inference…
9229225active
MLX
MLX is an array computation framework for machine learning on Apple silicon, developed by Apple ML research. It offers NumPy-like Python AP…
9428172active
PaddlePaddle/Paddle
PaddlePaddle is an industrial-grade deep learning framework written in C++ with Python APIs, supporting high-performance single-machine and…
8424062active
verl-project/verl
verl (Volcano Engine Reinforcement Learning) is a flexible, production-ready RL post-training library for large language models, open-sourc…
8423145active
kvcache-ai/ktransformers
KTransformers is a Python/C++ framework for CPU-GPU heterogeneous inference and fine-tuning of large language models, with a kt-kernel back…
9019303active
NVIDIA/Megatron-LM
NVIDIA's GPU-optimized library for training large transformer models at scale, comprising Megatron-LM (reference training scripts) and Mega…
9917615active
ggml-org/ggml
ggml is a plain C/C++ tensor library for machine learning with no dependencies, designed to be simple, portable, and efficient. It supports…
9915236stable
apache/tvm
Apache TVM is an open machine learning compiler framework that takes pre-trained models and compiles them into optimized, deployable module…
9013691active
OpenVINO
OpenVINO is an open-source toolkit from Intel for optimizing and deploying deep learning inference across CPU, GPU, and NPU hardware. It su…
9510740stable
facebookresearch/xformers
xFormers is a PyTorch-based library of hackable, optimized Transformer building blocks with custom CUDA kernels for fast, memory-efficient …
8810542active
skypilot-org/skypilot
SkyPilot is an open-source AI compute platform that unifies fragmented infrastructure (Kubernetes, Slurm, VMs, 20+ clouds) into a single po…
9710529active
deepseek-ai/DeepEP
DeepEP is a high-performance GPU communication library for expert parallelism (EP) in MoE training and inference, providing high-throughput…
5710066active
OpenRLHF/OpenRLHF
OpenRLHF is a high-performance, production-ready open-source RLHF framework built on Ray + vLLM + DeepSpeed for scalable reinforcement lear…
899956active
LTX-2
Official Python package from Lightricks providing inference pipelines and LoRA training for LTX-2/LTX-2.5, an open-weights DiT-based founda…
839260active
NVlabs/Sana
SANA is an efficiency-oriented PyTorch codebase for high-resolution text-to-image and text-to-video generation built on Linear Diffusion Tr…
748833active
THUDM/slime
slime is an open-source LLM post-training framework for reinforcement learning scaling, connecting Megatron-based training with SGLang-base…
808261active
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, quantizing, deploying, and serving large language models, built around its high-performance TurboMin…
958024active
isaac-sim/IsaacLab
Isaac Lab is a GPU-accelerated open-source framework for robot learning built on NVIDIA Isaac Sim, unifying workflows like reinforcement le…
927966active
wang-xinyu/tensorrtx
A C++ collection of popular deep learning networks (YOLO variants, ResNet, MobileNet, Swin Transformer, OCR models, and more) implemented f…
767827active
EmbarkStudios/rust-gpu
rust-gpu is a compiler toolchain that makes Rust a first-class language for writing GPU graphics and compute shaders, compiling Rust code t…
107568active
EleutherAI/gpt-neox
GPT-NeoX is EleutherAI's library for training large-scale autoregressive transformer language models on GPUs, built on NVIDIA's Megatron an…
627459active
NVIDIA/warp
NVIDIA Warp is a Python framework that JIT-compiles regular Python functions into efficient CPU or CUDA GPU kernels. It provides differenti…
987033active
leejet/stable-diffusion.cpp
A pure C/C++ inference engine for diffusion models (Stable Diffusion, FLUX, Wan, Qwen Image, Z-Image, and more) built on ggml in the style …
916846active
halide/Halide
Halide is an embedded DSL (in C++ and Python) for writing high-performance, data-parallel image and array processing pipelines. It separate…
706590stable
kvcache-ai/Mooncake
Mooncake is a KVCache-centric disaggregated serving platform for LLM inference, originally built to serve Kimi by Moonshot AI. It separates…
916398active
vllm-project/vllm-omni
vLLM-Omni is a Python framework extending vLLM for efficient inference and serving of omni-modality models, including diffusion transformer…
836369active
aidlearning/AidLearning-FrameWork
AidLux (originally AidLearning) is an AIoT development platform that runs a native Ubuntu Linux environment with GUI, deep learning tooling…
705797active
pjreddie/darknet
Darknet is an open-source neural network framework written in C and CUDA, best known as the original home of the YOLO real-time object dete…
3226492maintenance
NVIDIA/DALI
NVIDIA DALI is a GPU-accelerated data loading and preprocessing library with optimized building blocks and an execution engine for deep lea…
925734active
areal-project/AReaL
AReaL is a large-scale asynchronous reinforcement learning system that bridges foundation model training with agent-based applications, sup…
875696active
pytorch/torchtitan
torchtitan is a PyTorch-native platform for large-scale training of generative AI models, offering a clean-room implementation of PyTorch's…
795667active
fla-org/flash-linear-attention
A PyTorch library providing hardware-efficient implementations of emerging sequence model architectures, including linear attention, sparse…
885627active
nerfstudio-project/gsplat
gsplat is an open-source Python library with CUDA-accelerated, differentiable rasterization of Gaussians, based on 3D Gaussian Splatting fo…
705589active
mosaicml/composer
Composer is an open-source PyTorch-based deep learning training library by MosaicML (now Databricks) for training neural networks faster an…
655495active
lightvector/KataGo
KataGo is an open-source Go (baduk) engine trained via AlphaZero-like self-play, one of the strongest Go bots available. It runs as a GTP e…
995036active
RLinf/RLinf
RLinf is an open-source, flexible and scalable reinforcement learning training infrastructure for embodied AI (vision-language-action model…
744655active
mosaicml/llm-foundry
LLM Foundry is a PyTorch-based codebase for training, finetuning, evaluating, and deploying large language models from 125M to 70B+ paramet…
654441active
hao-ai-lab/FastVideo
FastVideo is a unified Python framework for post-training and real-time inference of video diffusion models, covering data preprocessing, f…
804076active
FedML-AI/FedML
FedML (TensorOpera) is a unified Python library for large-scale distributed training, model serving, and federated learning across GPU clou…
454062active
Nunchaku
Nunchaku is a high-performance inference engine for 4-bit quantized diffusion models (and LLMs) based on the SVDQuant technique from an ICL…
653937active
iree-org/iree
IREE is an MLIR-based end-to-end machine learning compiler and runtime that lowers models from frameworks like PyTorch, TensorFlow, JAX, an…
873901active
predibase/lorax
LoRAX is a multi-LoRA inference server that serves thousands of fine-tuned LLM adapters on a single GPU by sharing a common base model. It …
623826active
vllm-project/llm-compressor
LLM Compressor is a Python library for applying quantization and pruning algorithms to large language models, producing compressed-tensors …
903726active
NVIDIA/TransformerEngine
Transformer Engine is an NVIDIA library for accelerating Transformer model training and inference on NVIDIA GPUs using low-precision format…
993504active
NVIDIA/Model-Optimizer
NVIDIA Model Optimizer (ModelOpt) is a Python library of state-of-the-art model optimization techniques including quantization, pruning, di…
913488active
huggingface/optimum
Optimum is a Hugging Face library that extends Transformers, Diffusers, timm, and Sentence Transformers with hardware-specific optimization…
983469active
alibaba/ROLL
ROLL is an open-source reinforcement learning library from Alibaba for training large language models at scale, supporting algorithms like …
783374active
determined-ai/determined
Determined is an open-source deep learning platform that combines distributed training, hyperparameter tuning, experiment tracking, and GPU…
393236active
Jittor/jittor
Jittor is a high-performance deep learning framework from Tsinghua University based on just-in-time (JIT) compilation and meta-operators, w…
673229active
LeelaChessZero/lc0
Lc0 is an open-source, UCI-compliant chess engine that plays chess using neural networks trained via AlphaZero-style self-play reinforcemen…
653193active
NVIDIA/skills
A catalog of NVIDIA-verified Agent Skills — portable instruction sets that teach AI coding agents like Claude Code and Codex how to use NVI…
593110active
heavyai/heavydb
HeavyDB (formerly MapD/OmniSciDB) is an open-source SQL-based, relational, columnar database engine that uses CPUs and NVIDIA GPUs to query…
723057active
deepseek-ai/DualPipe
DualPipe is a Python library implementing a bidirectional pipeline parallelism algorithm that overlaps forward and backward computation wit…
482998active
pytorch/ao
TorchAO is a PyTorch-native library for model optimization through quantization and sparsity. It supports quantizing weights, gradients, op…
892957active
luminal-ai/luminal
Luminal is a high-performance general-purpose ML inference compiler written in Rust that lowers models to a minimal 15-op dataflow IR and c…
782956active
yunionio/cloudpods
Cloudpods is an open-source, Golang-based cloud-native unified multi/hybrid-cloud platform ('a cloud on clouds') that manages on-premise KV…
772935active

← prev page 3 / 4 next →