microsoft/waza

Health v2 · maintenance only

Adoption not part of the score

1280 stars · 79 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Waza is a Go CLI from Microsoft for evaluating AI agent skills through structured benchmarks. Users define test cases and validation rules in YAML, run them against different AI models, and compare results via graders, metrics, and a web dashboard.

Use cases

• evaluate ai agent skills with benchmarks
• compare llm performance across models
• run regression tests on agent prompts in ci
• scaffold an eval suite for a new skill
• validate ai task completion quality with graders
• track skill effectiveness over time with a dashboard

When to choose

• you build or maintain AI agent skills and need measurable quality metrics
• you want YAML-defined evals runnable locally and in GitHub Actions
• you need cross-model comparison of agent behavior

When to avoid

• you need general-purpose LLM app tracing or observability rather than skill benchmarking
• you want a GUI-first evaluation platform with no CLI workflow
• you need training or fine-tuning tooling rather than evaluation

Facets

cli-tool · maturity active

benchmarking testing cli agent-framework developer-tools ci-cd data-visualization artificial-intelligence developer-tools testing large-language-models windows cli go ai-agent-skills eval-suite yaml-benchmarks model-comparison graders github-copilot ci-cd-integration microsoft ai-agents linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/waza")