huggingface/Math-Verify

Health v2 · maintenance only

Adoption not part of the score

1186 stars · 58 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A Python library from Hugging Face for robustly parsing and verifying mathematical expressions, designed to evaluate Large Language Model outputs on math tasks. It extracts answers from LaTeX, plain expressions, and strings, then checks equivalence with flexible comparison logic.

Use cases

• evaluate llm outputs on math benchmarks like MATH
• verify if two mathematical expressions are equivalent
• extract answers from latex model responses
• grade math answers in an evaluation harness
• parse latex math expressions in python
• compare set and interval expressions for equality

When to choose

• you are benchmarking LLMs on mathematical reasoning tasks
• you need robust extraction of answers from free-form or LaTeX model output
• existing evaluators like the Harness or Qwen's undercount model performance
• you need exact handling of sets, intervals, equations, and units

When to avoid

• you need a general-purpose computer algebra system
• you only need simple numeric comparison without answer extraction
• your project is not Python-based

Facets

library · maturity active

parser nlp testing math large-language-models education python math-evaluation llm-benchmarking latex-parsing answer-verification antlr natural-language-processing algorithms

Member repositories

For agents

markdown · JSON · MCP: product_card(name="huggingface/Math-Verify")