kyuz0/amd-strix-halo-toolboxes

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1881 stars · 189 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of pre-built Toolbx/Docker containers ('toolboxes') for running llama.cpp LLM inference on AMD Ryzen AI Max 'Strix Halo' integrated GPUs, with Vulkan and ROCm backend variants. It also includes host configuration guides, performance benchmarks, and a VRAM/memory planning estimator.

Use cases

• run llama.cpp on AMD Strix Halo iGPU
• set up ROCm or Vulkan LLM inference on Ryzen AI Max
• benchmark llama.cpp performance on gfx1151
• estimate VRAM needs for local LLMs
• run local LLMs in containers on Fedora
• distributed LLM inference across Strix Halo machines

When to choose

• you have an AMD Ryzen AI Max (Strix Halo) machine and want pre-tuned llama.cpp containers
• you want tested Vulkan/ROCm backend options with known-good kernel and firmware versions
• you want benchmarks and memory planning guidance for iGPU LLM inference

When to avoid

• you have an NVIDIA GPU or non-Strix-Halo AMD hardware
• you want a polished GUI app rather than CLI containers
• you need production support or a formal license - it's a hobby project

Facets

application · maturity active

llm-inference container-runtime benchmarking developer-tools large-language-models gpu-computing developer-tools self-hosted cli llama.cpp strix-halo rocm vulkan toolbx amd-ryzen-ai-max gfx1151 containers local-llm linux docker amd

Member repositories

For agents

markdown · JSON · MCP: product_card(name="kyuz0/amd-strix-halo-toolboxes")