Ross ROSS = Recommend OSS · open-source software intelligence for agents

resource: gpu-computing

81 resources, primary matches first, then adoption-weighted; health v2 shown.

ResourceHealth v2StarsMaturity
Infrasys-AI/AISystem
An open-source Chinese-language course (with Jupyter notebooks, slides, and videos) covering the full AI systems stack: AI chips and archit…
5017667active
srush/GPU-Puzzles
An interactive Jupyter notebook of programming puzzles that teaches beginner GPU/CUDA kernel programming using Numba's Python-to-CUDA mappi…
3212428stable
xlite-dev/LeetCUDA
A collection of modern CUDA learning notes with PyTorch integration for beginners, featuring 200+ CUDA kernels, 100+ LLM/CUDA blogs, and hi…
9311836active
NVIDIA/cuda-samples
NVIDIA's official collection of sample programs demonstrating CUDA Toolkit features, written in C++ and built with CMake. It serves as refe…
849554active
pytorch/tutorials
The official PyTorch tutorials repository, containing Sphinx-style documentation with runnable Python examples and Jupyter notebooks coveri…
779290active
deepseek-ai/open-infra-index
An index repository from DeepSeek AI cataloging their production-tested open-source AI infrastructure tools, including FlashMLA, DeepEP, De…
308059active
gpu-mode/lectures
A collection of supplementary materials (notebooks, slides, and code) for the GPU MODE lecture series on GPU programming and CUDA kernel de…
656505active
gpuweb/gpuweb
The W3C GPU for the Web Community Group repository hosting the WebGPU API and WGSL (WebGPU Shading Language) specification documents. It is…
775460active
K11MCH1/AdrenoToolsDrivers
A repository of prebuilt custom Adreno GPU drivers (Qualcomm-extracted and Mesa Turnip builds) for Android emulators like Skyline, Strato, …
695083active
openmlsys/openmlsys
An open-source bilingual (Chinese/English) textbook, 'Machine Learning Systems: Design and Implementation', covering the full ML systems st…
654845active
NVIDIA/nvidia-container-toolkit
The NVIDIA Container Toolkit enables building and running GPU-accelerated containers by providing a container runtime library and utilities…
944528stable
skyzh/tiny-llm
A hands-on course for systems engineers to build an LLM inference and serving system from scratch on Apple Silicon using MLX, implementing …
644523active
Infatoshi/cuda-course
A free open-source CUDA programming course published with FreeCodeCamp, teaching GPU kernel development from C/C++ basics through optimized…
553972active
BBuf/how-to-optim-algorithm-in-cuda
A curated collection of notes and hands-on code for optimizing algorithms on CUDA GPUs, covering handwritten kernels, CUTLASS/CuTe, Triton,…
983223active
Tony-Tan/CUDA_Freshman
A collection of CUDA example programs accompanying a Chinese-language blog tutorial series on GPU programming, partly based on the book 'Pr…
322792stable
gpu-mode/Triton-Puzzles
A set of interactive Jupyter notebook puzzles for learning the Triton GPU programming language from first principles. The puzzles run via a…
592572active
gpu-mode/resource-stream
A community-curated collection of links to CUDA and GPU programming resources, including books, papers, blog posts, YouTube videos, tweets,…
652303active
brucefan1983/CUDA-Programming
Sample source code accompanying a Chinese CUDA programming book (with an English version in progress) by Bruce Fan. It provides runnable CU…
482091active
wafer-ai/gpu-perf-engineering-resources
A curated list of resources for learning AI/GPU performance engineering, ordered from GPU fundamentals through kernel optimization, inferen…
602080active
SciML/SciMLBook
An open online book compiling lecture notes from MIT course 18.337J/6.338J on parallel computing and scientific machine learning (SciML). I…
672036active
mikbry/awesome-webgpu
A curated awesome-list of WebGPU resources including specifications, tutorials, libraries, demos, and debugging tools. It serves as a refer…
611965active
NVIDIA/accelerated-computing-hub
NVIDIA's curated hub of open educational materials for GPU computing, including interactive Jupyter notebook tutorials on CUDA C++, CUDA Py…
681935active
cfregly/ai-performance-engineering
Code, labs, and resources accompanying the O'Reilly book 'AI Systems Performance Engineering', covering GPU optimization, distributed train…
631863active
caomaolufei/AIInfraGuide
An open-source Chinese-language knowledge base and learning guide covering the full AI infrastructure stack, from GPU hardware and CUDA pro…
581806active
jamesob/local-llm
A personal guide and configuration repository for running state-of-the-art LLMs and speech-to-text locally on consumer/prosumer hardware. I…
541800active
mjun0812/flash-attention-prebuild-wheels
A repository that distributes pre-built flash-attention 2 and 3 wheel packages for Linux and Windows, built via GitHub Actions, AWS CodeBui…
831706active
NVIDIA/trt-samples-for-hackathon-cn
An NVIDIA-maintained tutorial repository for TensorRT beginners and developers, containing a 'cookbook' of rich code examples covering API …
841666active
kai-scheduler/KAI-Scheduler
KAI Scheduler is a Kubernetes-native scheduler written in Go that optimizes GPU resource allocation for AI and machine learning workloads a…
821472active
Liu-xiandong/How_to_optimize_in_GPU
A tutorial series repository teaching CUDA kernel optimization with detailed walkthroughs of elementwise, reduce, sgemv, and sgemm kernels.…
321350stable
autonomous-ai/autonomous-computer
An open-source hardware project providing complete build guides (parts lists, CAD, BIOS settings, assembly photos) for Personal AI Computer…
621330active
siboehm/SGEMM_CUDA
An educational repository demonstrating step-by-step optimization of a CUDA SGEMM (matrix multiplication) kernel from a naive implementatio…
501294stable
datawhalechina/diy-llm
A Chinese-language, code-driven course (adapted from Stanford CS336) for systematically building large language models from scratch. It cov…
791278active
modal-labs/modal-examples
A curated collection of example programs for Modal, a serverless cloud platform, covering use cases like LLM serving, image generation, spe…
771264active
mlc-ai/modern-gpu-programming-for-mlsys
An open online book from the MLC team teaching modern GPU kernel programming for machine learning systems, progressing from GPU hardware fu…
591239active
pytorch/extension-cpp
An official PyTorch example repository demonstrating how to write C++/CUDA extensions with custom ops. It includes two variants: one using …
601203active
srush/LLM-Training-Puzzles
A collection of 8 challenging Jupyter notebook puzzles about training large language models on many GPUs, teaching memory efficiency and co…
291190stable
lisa-lab/DeepLearningTutorials
A collection of deep learning tutorial notes and Python code from the LISA lab, teaching core deep learning algorithms using the Theano lib…
324150maintenance
deepseek-ai/profile-data
A public release of PyTorch Profiler traces from DeepSeek's V3/R1 training and inference infrastructure, showing computation-communication …
251182active
MiaAI-Lab/DeepSeek-v4-Flash-DSpark-2x-DGX-Spark
A deployment recipe for serving DeepSeek-V4-Flash-0731 across two NVIDIA DGX Spark nodes using vLLM with tensor parallelism and DSpark spec…
581176active
oneapi-src/oneAPI-samples
A collection of sample code for Intel oneAPI Toolkits, covering SYCL C++, Python, and Fortran across CPU, GPU, and FPGA targets. Samples ar…
701160active
gpu-mode/awesomeMLSys
A curated reading list of papers, videos, and repositories for onboarding into ML Systems, covering attention mechanisms, LLM inference, an…
551120active
AlphaGPU/leetgpu-challenges
A collection of GPU programming challenges for the LeetGPU.com platform, containing problem descriptions, reference implementations, test c…
631114active
Tongkaio/CUDA_Kernel_Samples
A curated collection of hand-written CUDA kernel samples covering common operators like elementwise add, reduction, softmax, sgemm, and tra…
421095active
PaddleJitLab/CUDATutorial
A self-learning tutorial repository for CUDA high-performance programming, structured as progressive lesson series from beginner environmen…
601087active
jmaczan/tiny-vllm
tiny-vllm is both a minimal high-performance LLM inference engine written in C++ and CUDA, and a hands-on course that walks through buildin…
601081active
MichalDanielDobrzanski/DeepLearningPython
Python 3.5.2 port of the companion scripts for the book 'Neural Networks and Deep Learning' (neuralnetworksanddeeplearning.com), including …
322830maintenance
jbush001/NyuziProcessor
Nyuzi is an experimental open-source GPGPU microprocessor architecture with a synthesizable SystemVerilog hardware design, instruction set …
322218maintenance
XiongjieDai/GPU-Benchmarks-on-LLM-Inference
A curated benchmark dataset comparing LLM inference speeds (tokens/s) across many NVIDIA GPUs and Apple Silicon chips using llama.cpp on LL…
281935maintenance
godweiyang/NN-CUDA-Example
A collection of simple example projects showing how to write custom CUDA operators and call them from PyTorch and TensorFlow. It demonstrat…
321538maintenance
PacktPublishing/Learn-CUDA-Programming
The companion code repository for the Packt book 'Learn CUDA Programming', a beginner's guide to GPU programming and parallel computing wit…
321261maintenance
nolanaatama/sd-1click-colab
A collection of Jupyter Notebook scripts for running Stable Diffusion with one-click setup on Google Colab. It automates installing and lau…
311078maintenance
LitLeo/TensorRT_Tutorial
A Chinese-language tutorial and resource collection for NVIDIA TensorRT, including translated user guides, sample walkthroughs, plugin deve…
321051maintenance
olcf/cuda-training-series
A repository of training materials accompanying NVIDIA's CUDA Training Series presented at ORNL and NERSC. It contains example code and exe…
321042maintenance
Temaran/UnrealEngineShaderPluginDemo
A tutorial project and plugin demonstrating how to implement custom HLSL pixel and compute shaders in Unreal Engine 4 via C++. It covers ho…
321007maintenance
NVIDIA/nvidia-docker
NVIDIA's original tooling for building and running Docker containers that leverage NVIDIA GPUs, providing CUDA support inside containers. T…
1017591abandoned
udacity/cs344
Course code for Udacity's CS344 Introduction to Parallel Programming class, containing CUDA-based homework assignments and exercises. The r…
101357abandoned
NVIDIA/nvidia-container-runtime
NVIDIA container runtime that allowed Docker and other container engines to run GPU-accelerated containers with CUDA support. This reposito…
101127abandoned
Infrasys-AI/AIInfra
AIInfra is an open-source Chinese-language course (text, slides, and videos) on AI infrastructure for large models, covering AI clusters, n…
498029active
ufoym/deepo
Deepo is a Dockerfile generator and collection of pre-built Docker images for setting up deep learning research environments. It composes m…
566276active
HuaizhengZhang/AI-Infra-from-Zero-to-Hero
A curated awesome-list of research papers, industry practices, and video tutorials on systems for machine learning, LLMs, and generative AI…
474309active
NVIDIA/GenerativeAIExamples
A collection of NVIDIA reference workflows, notebooks, and example projects for building generative AI systems on accelerated infrastructur…
624160active
CalvinXKY/InfraTech
A collection of Jupyter notebook tutorials and exercises covering AI infrastructure topics including PyTorch, vLLM/SGLang inference framewo…
593683active
zjhellofss/KuiperInfer
KuiperInfer is an open-source course that guides learners through building a high-performance deep learning inference engine from scratch i…
463496active
NVIDIA/gpu-operator
NVIDIA GPU Operator is a Kubernetes operator that automates the provisioning and lifecycle management of all NVIDIA software components nee…
952851active
ForceInjection/AI-fundamentals
A comprehensive Chinese-language learning resource collection covering the full AI infrastructure stack, from GPU/TPU hardware architecture…
692376active
eugr/spark-vllm-docker
A Docker configuration and set of shell scripts for running vLLM inference on NVIDIA DGX Spark hardware, from single nodes to multi-node cl…
832189active
YanWenKun/ComfyUI-Docker
A Dockerfile and startup scripts that package ComfyUI, a node-based Stable Diffusion GUI, into ready-to-run Docker images. It provides preb…
701637active
DataXujing/YOLOv8
A Chinese-language tutorial repository for training custom datasets with YOLOv8 (ultralytics 8.0.0) and deploying it end-to-end with NVIDIA…
311480active
NVIDIA/deepops
NVIDIA DeepOps is a collection of Ansible playbooks and scripts for deploying GPU clusters running Kubernetes or Slurm, including drivers, …
931468active
mythrantic/ollama-docker
A Docker Compose configuration that deploys Ollama together with its dependencies, including an Open WebUI chat frontend, in one command. I…
631418active
tanishqkumar/beyond-nanogpt
An educational repository of minimal, annotated, from-scratch implementations of ~100 modern deep learning techniques, bridging nanoGPT and…
481340active
ScalingIntelligence/KernelBench
KernelBench is a benchmark and toolkit from Stanford's Scaling Intelligence Lab that evaluates whether LLMs can generate correct and effici…
551214active
aws/deep-learning-containers
AWS Deep Learning Containers are pre-built, security-patched Docker images for running AI/ML workloads on AWS services like EC2, EKS, and S…
961186active
QianMo/GPU-Gems-Book-Source-Code
A preserved archive of the companion CD source code for NVIDIA's GPU Gems books 1 through 3, containing C++ and HLSL/GLSL sample implementa…
321128stable
neural-maze/realtime-phone-agents-course
A hands-on course repository teaching how to build realtime AI voice agents that handle live phone calls. It covers FastRTC for low-latency…
531085active
mryab/efficient-dl-systems
Course materials for the Efficient Deep Learning Systems course taught at HSE University and Yandex School of Data Analysis. It covers GPU/…
701028active
NVIDIA-AI-IOT/deepstream_reference_apps
A collection of C++ reference applications demonstrating video analytics pipelines built on NVIDIA DeepStream SDK 9.0 and TensorRT for Tesl…
741355maintenance
NVIDIA-AI-IOT/jetracer
JetRacer is an open-source project for building an autonomous AI racecar powered by NVIDIA Jetson Nano. It provides Jupyter notebook exampl…
231191maintenance
floydhub/dl-docker
An all-in-one Docker image bundling popular deep learning frameworks (TensorFlow, Caffe, Theano, Torch, Keras, Lasagne) with CPU and GPU (C…
323853abandoned
floydhub/dl-setup
A detailed step-by-step guide for setting up a Linux machine for deep learning research, covering Nvidia drivers, CUDA, cuDNN, Python packa…
321963abandoned
alexsosn/iOS_ML
A curated awesome-list of machine learning, deep learning, NLP, computer vision, and speech resources for iOS developers, focusing on libra…
321427abandoned

page 1 / 1