function: benchmarking
824 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| openai/baselines OpenAI Baselines is a collection of high-quality reference implementations of reinforcement learning algorithms such as DQN, PPO, and ACKTR… | 32 | 16764 | maintenance |
| BrentOzarULTD/SQL-Server-First-Responder-Kit A collection of T-SQL stored procedures (sp_Blitz, sp_BlitzCache, sp_BlitzFirst, sp_BlitzIndex, and more) for Microsoft SQL Server health c… | 93 | 3890 | active |
| mseitzer/pytorch-fid A PyTorch port of the official TensorFlow implementation of the Fréchet Inception Distance (FID), a metric for measuring similarity between… | 23 | 3851 | stable |
| fortio/fortio Fortio is a Go-based load testing library, CLI tool, and web UI originally built for Istio. It generates load at a specified queries-per-se… | 95 | 3722 | stable |
| roboflow/trackers A Python library of clean-room, Apache 2.0 implementations of multi-object tracking algorithms including SORT, ByteTrack, OC-SORT, BoT-SORT… | 85 | 3717 | active |
| LinShunKang/MyPerf4J MyPerf4J is a high-performance Java application performance monitoring (APM) tool implemented as a non-intrusive JavaAgent using ASM byteco… | 72 | 3559 | active |
| RUC-NLPIR/FlashRAG FlashRAG is a modular Python toolkit for reproducing and developing Retrieval-Augmented Generation (RAG) research, bundling 36 pre-processe… | 68 | 3557 | active |
| davidmarkclements/0x 0x is a single-command Node.js profiling tool that generates interactive flamegraphs from stack traces. It wraps any Node process, captures… | 43 | 3548 | active |
| edtechre/pybroker PyBroker is a Python framework for developing algorithmic trading strategies with a focus on machine learning. It provides a fast NumPy/Num… | 93 | 3515 | active |
| namhyung/uftrace uftrace is a function call graph tracer for C, C++, Rust, and Python programs that records function entry/exit with timestamps, arguments, … | 79 | 3460 | active |
| badafans/better-cloudflare-ip A Go CLI tool that finds the best-performing Cloudflare Anycast IP addresses for a user's specific network environment. It randomly samples… | 76 | 3444 | active |
| yandex/perforator Perforator is a cluster-wide continuous profiling tool by Yandex that collects CPU profiles from production servers using eBPF with negligi… | 78 | 3417 | active |
| microsoft/nni NNI (Neural Network Intelligence) is an open-source AutoML toolkit from Microsoft that automates hyperparameter tuning, neural architecture… | 10 | 14361 | maintenance |
| xdebug/xdebug Xdebug is a PHP extension providing step debugging, profiling, tracing, code coverage, and improved error reporting for PHP applications. I… | 90 | 3414 | active |
| minitest/minitest Minitest is a small, fast, and readable testing suite for Ruby supporting TDD, BDD, spec-style expectations, and benchmarking. It ships as … | 74 | 3411 | stable |
| embeddings-benchmark/mteb MTEB (Massive Text Embedding Benchmark) is a Python library and CLI for benchmarking embedding models across 1000+ tasks, languages, and mo… | 95 | 3406 | active |
| NovaSky-AI/SkyThought SkyThought is the open-source repository behind Sky-T1, a family of reasoning language models trained for under $450, including training sc… | 25 | 3399 | active |
| IQA-PyTorch A pure Python/PyTorch toolbox for image quality assessment (IQA) providing GPU-accelerated reimplementations of many full-reference and no-… | 82 | 3380 | active |
| AltraMayor/f3 F3 (Fight Flash Fraud) is a command-line tool that tests flash storage devices like SD cards and USB drives to detect counterfeit capacity … | 82 | 3358 | stable |
| bojand/ghz ghz is a command-line utility and Go package for benchmarking and load testing gRPC services. It supports unary, streaming, and duplex call… | 73 | 3348 | active |
| shankarpandala/lazypredict Lazy Predict is a Python library that trains dozens of machine learning models with minimal code to quickly identify which algorithms perfo… | 78 | 3347 | active |
| intel/pcm Intel Performance Counter Monitor (PCM) is an API and a set of tools for monitoring performance and energy metrics of Intel Core, Xeon, Ato… | 80 | 3318 | active |
| Celtoys/Remotery Remotery is a realtime CPU/GPU profiler implemented in a single C file, with a remote web-browser viewer for inspecting sampled traces. It … | 23 | 3313 | stable |
| modelscope/evalscope EvalScope is a Python framework from the ModelScope community for evaluating large language models, vision-language models, embedding model… | 93 | 3312 | active |
| catchpoint/WebPageTest The official open-source codebase for WebPageTest, the website performance testing service, which can be self-hosted as a private instance.… | 42 | 3290 | active |
| mljar/mljar-supervised MLJAR AutoML is a Python package for automated machine learning on tabular data, providing feature engineering, hyperparameter tuning, mode… | 91 | 3287 | active |
| oracle/visualvm VisualVM is an all-in-one visual troubleshooting and profiling tool for Java applications, integrating command-line JDK tools with lightwei… | 78 | 3262 | stable |
| pyutils/line_profiler line_profiler is a Python module for line-by-line profiling of functions, with the kernprof script for running profilers. It is the officia… | 78 | 3243 | active |
| DynamoRIO/dynamorio DynamoRIO is a runtime code manipulation system that supports arbitrary code transformations on executing programs, with a powerful instruc… | 95 | 3146 | active |
| alexei-led/pumba Pumba is a chaos testing and network emulation CLI tool for Docker, containerd, and Podman containers. It can kill, stop, pause, or remove … | 99 | 3137 | active |
| phoronix-test-suite/phoronix-test-suite The Phoronix Test Suite is an open-source, cross-platform automated benchmarking and testing platform written in PHP. It provides an extens… | 65 | 3115 | stable |
| felixge/fgprof fgprof is a sampling Go profiler that analyzes both On-CPU and Off-CPU (e.g. I/O) time together, also known as wall-clock profiling. It exp… | 31 | 3110 | stable |
| thuml/Time-Series-Library TSLib is an open-source Python library providing a unified codebase of advanced deep learning models for general time series analysis. It s… | 66 | 12785 | maintenance |
| zombocom/derailed_benchmarks A Ruby gem providing a suite of benchmarking and profiling tools for Rails and Ruby applications. It measures memory usage of Gemfile depen… | 32 | 3063 | active |
| hegelai/prompttools PromptTools is an open-source Python library for testing, experimenting with, and evaluating prompts, LLMs (OpenAI, Anthropic, LLaMA, etc.)… | 50 | 3051 | active |
| open-quantum-safe/liboqs liboqs is an open source C library providing implementations of quantum-resistant (post-quantum) key encapsulation mechanisms and digital s… | 88 | 3044 | active |
| hydradatabase/columnar Hydra Columnar is a Postgres extension providing column-oriented table storage via the table access method API, enabling fast analytical qu… | 26 | 3039 | stable |
| tensorflow/agents TF-Agents is a TensorFlow-based Python library for building, training, and deploying reinforcement learning and contextual bandit algorithm… | 60 | 3025 | active |
| MiniProfiler/dotnet MiniProfiler is a lightweight profiling library and UI for .NET, ASP.NET, and ASP.NET Core applications. It shows where time is spent in re… | 49 | 3009 | stable |
| sovrasov/flops-counter.pytorch A Python library (ptflops) that computes the theoretical number of multiply-add operations (FLOPs) and parameter counts for neural network … | 41 | 2982 | active |
| bethgelab/foolbox Foolbox is a Python library for generating adversarial examples that fool deep neural networks, with state-of-the-art gradient-based and de… | 48 | 2972 | active |
| pmorissette/bt bt is a flexible Python backtesting framework for testing quantitative trading strategies. It uses composable Algos and AlgoStacks with a t… | 92 | 2966 | active |
| ekzhu/datasketch datasketch is a Python library of probabilistic data structures (MinHash, Weighted MinHash, HyperLogLog, HyperLogLog++) and indexes (MinHas… | 91 | 2959 | stable |
| keras-team/keras-tuner KerasTuner is a hyperparameter optimization framework for Keras models with a define-by-run syntax for configuring search spaces. It ships … | 53 | 2923 | active |
| DLR-RM/rl-baselines3-zoo RL Baselines3 Zoo is a training framework for reinforcement learning agents built on Stable Baselines3. It provides CLI scripts for trainin… | 92 | 2870 | active |
| symfony/stopwatch A Symfony component that provides a simple stopwatch API for profiling PHP code by timing named events, laps, and sections. It is a lightwe… | 90 | 2811 | stable |
| awslabs/amazon-redshift-utils A collection of Python utilities, admin scripts, views, and stored procedures for managing and optimizing Amazon Redshift data warehouse cl… | 50 | 2807 | active |
| huawei-noah/HEBO A research monorepo from Huawei Noah's Ark Lab containing official implementations of Bayesian optimization, reinforcement learning, and ge… | 52 | 2797 | active |
| facebook/Ax Ax is a Python platform for adaptive experimentation that uses machine learning (Bayesian and bandit optimization via BoTorch) to efficient… | 95 | 2792 | active |
| RoboTwin-Platform/RoboTwin RoboTwin 2.0 is a scalable benchmark and data-generation platform for bimanual (dual-arm) robotic manipulation, built on simulated digital … | 68 | 2772 | active |
| gem5/gem5 gem5 is the official open-source computer-system architecture simulator for research and teaching, modeling processor microarchitecture and… | 88 | 2771 | active |
| RazrFalcon/cargo-bloat A cargo subcommand that analyzes Rust executables to show which functions and crates take up the most space in the binary. It supports ELF,… | 32 | 2762 | stable |
| ColinIanKing/stress-ng stress-ng is a command-line stress testing tool with 380+ stressors that exercise CPU, memory, filesystem, and OS kernel interfaces. It is … | 95 | 2748 | active |
| openjdk/jmh JMH is the Java Microbenchmark Harness, a tool for building, running, and analysing nano/micro/milli/macro benchmarks on the JVM. It genera… | 74 | 2671 | stable |
| TheTumultuousUnicornOfDarkness/CPU-X CPU-X is a free and open-source system profiling and monitoring application for GNU/Linux and FreeBSD, similar to CPU-Z on Windows. It repo… | 76 | 2648 | active |
| jmcarpenter2/swifter Swifter is a Python library that speeds up pandas apply operations by automatically choosing the fastest execution strategy, whether vector… | 32 | 2635 | active |
| NoiseByNorthwest/php-spx SPX is a PHP profiling extension written in C that collects function-level performance metrics (time, memory, I/O) with full call stack con… | 74 | 2629 | active |
| processone/tsung Tsung is a multi-protocol distributed load testing and benchmarking tool written in Erlang. It simulates thousands of clients to test the s… | 64 | 2629 | active |
| yandex/yandex-tank Yandex.Tank is an extensible open-source load and performance testing tool for Linux, supporting multiple load generators such as Phantom, … | 67 | 2596 | active |
| linux-test-project/ltp The Linux Test Project is a collection of test suites and tools for validating the reliability, robustness, and stability of the Linux kern… | 86 | 2589 | active |
| rbspy/rbspy rbspy is a sampling CPU profiler for Ruby that can profile already-running processes by PID or launch new ones, with low overhead safe for … | 97 | 2573 | active |
| jiffyclub/snakeviz SnakeViz is a browser-based graphical viewer for Python cProfile output, serving as a visual alternative to the pstats module. It runs as a… | 63 | 2566 | stable |
| GameTechDev/PresentMon PresentMon is a set of tools for capturing and analyzing the performance characteristics of graphics applications on Windows, tracing frame… | 88 | 2537 | active |
| huggingface/lighteval Lighteval is Hugging Face's all-in-one toolkit for evaluating large language models across multiple inference backends (Transformers, vLLM,… | 77 | 2527 | active |
| EMI-Group/evox EvoX is a distributed GPU-accelerated framework for evolutionary computation, compatible with PyTorch and built on JAX. It provides 50+ evo… | 80 | 2526 | active |
| evanwashere/mitata Mitata is a microbenchmarking library for JavaScript runtimes (Bun, Deno, Node.js) and C++ via a single header. It provides a clean API for… | 37 | 2520 | active |
| Lightning-AI/torchmetrics TorchMetrics is a PyTorch-native library of machine learning metrics that work in distributed and scalable training pipelines. It provides … | 90 | 2461 | stable |
| stephencookdev/speed-measure-webpack-plugin A webpack plugin that measures and reports the time spent in each loader and plugin during webpack builds. It wraps your webpack config and… | 68 | 2443 | active |
| google/XNNPACK XNNPACK is a highly optimized C library of floating-point neural network inference operators for ARM, x86, WebAssembly, and RISC-V platform… | 77 | 2435 | active |
| youngyangyang04/Skiplist-CPP A lightweight key-value storage engine implemented in C++ using a skiplist as the core data structure, supporting insert, delete, search, d… | 32 | 2399 | stable |
| gkamradt/needle-in-a-haystack A benchmarking tool (niah / needlehaystack) that pressure-tests LLM long-context retrieval by sweeping context length x needle depth cells … | 72 | 2375 | active |
| yse/easy_profiler A lightweight cross-platform profiler library for C++ that instruments arbitrary code blocks with extremely low overhead (~15ns per block).… | 66 | 2371 | stable |
| uptrain-ai/uptrain UpTrain is an open-source Python platform for evaluating and improving LLM applications, offering 20+ preconfigured evaluation checks cover… | 23 | 2362 | active |
| tinylibs/tinybench Tinybench is a tiny (~10KB) JavaScript benchmarking library built on Web APIs with accurate timing via process.hrtime or performance.now. I… | 98 | 2360 | active |
| vava-nessa/free-coding-models A CLI tool that tracks a large catalog of free coding LLM models across 20+ providers in real time, benchmarking their speed and stability.… | 78 | 2345 | active |
| mrdoob/stats.js A tiny JavaScript library that displays an on-page info box monitoring rendering performance, showing FPS, frame time in milliseconds, and … | 23 | 9148 | maintenance |
| wilicc/gpu-burn GPU Burn is a multi-GPU CUDA stress test tool that pushes NVIDIA GPUs to maximum load for stability and thermal testing. It supports config… | 70 | 2322 | active |
| marmelab/gremlins.js gremlins.js is a JavaScript monkey testing library for Node.js and the browser that unleashes random user-like actions (clicking, typing, s… | 23 | 9091 | maintenance |
| HdrHistogram/HdrHistogram HdrHistogram is a Java library for recording and analyzing sampled data value counts across a configurable integer value range with configu… | 23 | 2316 | stable |
| oneclickvirt/ecs A comprehensive VPS/server benchmarking tool written in Go that tests system information, network performance, and IP quality with zero env… | 86 | 2312 | active |
| fcsonline/drill Drill is a lightweight HTTP load testing tool written in Rust, designed as a JVM-free alternative to tools like JMeter. Benchmark plans are… | 86 | 2308 | active |
| gperftools/gperftools gperftools (Google Performance Tools) is a collection of high-performance multi-threaded malloc implementations (tcmalloc) plus CPU and hea… | 84 | 8978 | maintenance |
| macbre/phantomas A headless Chromium-based web performance metrics collector and monitoring tool built on Node.js and Puppeteer. It loads pages in a headles… | 90 | 2260 | active |
| facebookresearch/fvcore fvcore is a lightweight Python core library providing common functionality shared across FAIR's computer vision frameworks such as Detectro… | 76 | 2250 | stable |
| andikleen/pmu-tools pmu-tools is a collection of Python tools and C libraries for profile collection and performance analysis on Intel CPUs, built on top of Li… | 75 | 2245 | active |
| cyring/CoreFreq CoreFreq is a CPU monitoring and tuning tool for 64-bit processors that combines a Linux kernel module with a terminal UI to report frequen… | 98 | 2238 | active |
| PragmaticFlow/NBomber NBomber is a distributed load-testing framework for .NET that lets you write load test scenarios in plain C# or F# with no dependency on pr… | 94 | 2238 | active |
| IBM/AssetOpsBench AssetOpsBench is an open-source benchmark and framework from IBM for building, orchestrating, and evaluating domain-specific AI agents for … | 64 | 2237 | active |
| P403n1x87/austin Austin is a frame stack sampler for CPython written in C, used to profile running Python processes without instrumentation. It samples stac… | 72 | 2209 | active |
| scandum/quadsort Quadsort is a branchless stable adaptive merge sort implemented in C, designed to outperform quicksort on many workloads. It uses a quad sw… | 32 | 2203 | active |
| tmm1/stackprof Stackprof is a sampling call-stack profiler for Ruby 2.2+ inspired by gperftools. It collects CPU, wall, object, and other profile samples … | 65 | 2192 | stable |
| BIMK/PlatEMO PlatEMO is a MATLAB-based platform for evolutionary multi-objective optimization developed by BIMK at Anhui University. It provides 300+ op… | 90 | 2174 | active |
| rurban/smhasher SMhasher is a test suite for evaluating the quality and speed of non-cryptographic and cryptographic hash functions. It benchmarks throughp… | 73 | 2169 | active |
| TsingZ0/PFLlib PFLlib is a beginner-friendly Python library and benchmark for traditional and personalized federated learning, offering 39 algorithms, 24 … | 59 | 2155 | active |
| microsoft/Microsoft.IO.RecyclableMemoryStream A .NET library that pools MemoryStream buffers to reduce garbage collection pressure and Large Object Heap allocations in performance-criti… | 67 | 2145 | stable |
| ompl/ompl OMPL is an open-source C++ library of over 40 sampling-based motion planning algorithms (RRT-Connect, PRM, RRT*, KPIECE, etc.) across more … | 95 | 2134 | stable |
| tairov/llama2.mojo A single-file implementation of Llama 2 transformer inference written in pure Mojo, leveraging SIMD and vectorization for fast CPU inferenc… | 57 | 2125 | active |
| bcoe/c8 c8 is a CLI tool that generates code coverage reports for Node.js applications using Node's built-in V8 coverage output, formatted with Ist… | 85 | 2119 | active |
| automl/auto-sklearn auto-sklearn is an automated machine learning (AutoML) toolkit that acts as a drop-in replacement for scikit-learn estimators, automaticall… | 63 | 8126 | maintenance |
| ContinualAI/avalanche Avalanche is an end-to-end continual learning library built on PyTorch, developed by ContinualAI. It provides modules for benchmarks, train… | 27 | 2088 | active |