meta-llama/PurpleLlama

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

4365 stars · 772 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Purple Llama is Meta's umbrella project of tools and benchmarks for assessing and improving the security of large language models. It includes CyberSecEval cybersecurity evaluations and Llama Guard input/output safeguard models for human-AI conversations.

Use cases

• evaluate cybersecurity risks of an LLM
• add safety filtering to LLM inputs and outputs
• red team a chatbot for unsafe responses
• benchmark a model for insecure code generation
• moderate human-AI conversations with a classifier

When to choose

• you need open benchmarks for LLM security risks
• you want a ready-made safeguard model for prompt and response moderation
• you are building responsibly with Llama or other open generative AI models

When to avoid

• you need general-purpose content moderation outside LLM safety
• you require a permissive license for the safeguard models themselves (they use the Llama Community license)
• you need a hosted SaaS safety API rather than self-run models

Facets

library · maturity active

security llm-inference machine-learning benchmarking prompt-engineering security large-language-models artificial-intelligence developer-tools python cross-platform llm-safety llama-guard cybersecurity-evals red-teaming input-output-safeguards trust-and-safety meta

Member repositories

For agents

markdown · JSON · MCP: product_card(name="meta-llama/PurpleLlama")