RightNow-AI/autokernel

Health v2 · maintenance only

Flags: no_releases young

Adoption not part of the score

1535 stars · 161 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

AutoKernel is an open-source autoresearch pipeline that takes any PyTorch model, profiles it to find GPU kernel bottlenecks, extracts them as Triton or CUDA C++ kernels, and lets an AI coding agent autonomously optimize them via an edit-benchmark-keep/revert loop. It ships with profiling, extraction, benchmarking, and verification scripts plus a comprehensive program.md that guides agents through hours of unattended optimization.

Use cases

• speed up my pytorch model with custom triton kernels
• automatically optimize gpu kernels overnight
• find which kernels are bottlenecks in my llama model
• generate cuda kernels faster than torch.compile
• benchmark and verify kernel correctness automatically
• reduce gpu inference costs for my model
• extract bottleneck ops from a pytorch model into standalone kernels

When to choose

• you have an NVIDIA GPU (H100/A100/RTX 4090) and a PyTorch model that is too slow
• you want autonomous, unattended kernel optimization driven by a coding agent like Claude or Codex
• you want verified correctness checks and roofline analysis alongside speedups
• you prefer an open-source MIT-licensed pipeline you can inspect and customize

When to avoid

• you have no NVIDIA GPU or use AMD/Apple silicon
• you need a fully managed, enterprise-supported drop-in kernel replacement service (the vendor's Forge product targets that)
• your model is tiny or already well-optimized so kernel-level gains are negligible
• you cannot run an external LLM coding agent in your environment

Facets

cli-tool · maturity active

machine-learning benchmarking gpu-computing llm-inference agent-framework developer-tools machine-learning gpu-computing performance developer-tools deep-learning python cli triton cuda-kernels kernel-optimization autonomous-agents pytorch autoresearch profiling amdahls-law linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="RightNow-AI/autokernel")