verazuo/jailbreak_llms resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

3791 stars · 329 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A research dataset accompanying the ACM CCS 2024 paper 'Do Anything Now', containing 15,140 ChatGPT prompts collected from Reddit, Discord, prompt-aggregation websites, and open-source datasets between December 2022 and December 2023, of which 1,405 are identified jailbreak prompts. It supports the JailbreakHub measurement framework, which analyzes jailbreak communities and attack strategies such as prompt injection and privilege escalation, and evaluates safeguard failure rates across six popular LLMs.

Use cases

• find a dataset of real jailbreak prompts targeting ChatGPT
• evaluate how well LLM safeguards resist adversarial prompts
• study how jailbreak prompts spread across Reddit and Discord
• train a classifier to detect jailbreak or harmful prompts
• red team an LLM using documented in-the-wild attack prompts
• benchmark multiple LLMs against prompt injection attacks
• research the accounts and communities that create jailbreak prompts

When to choose

• You need a large, labeled corpus of in-the-wild jailbreak and normal prompts for LLM safety research
• You want peer-reviewed data (CCS 2024) with measured attack success rates to benchmark model defenses
• You need to study the evolution, strategies, and authorship of jailbreak prompts over a full year

When to avoid

• You need prompts collected after December 2023, since the dataset's collection window has closed
• You want an attack tool or defense framework rather than a dataset for analysis
• Your project cannot handle harmful text, as the data contains offensive and dangerous content

Facets

dataset · maturity stable

security machine-learning nlp benchmarking testing artificial-intelligence large-language-models security python cross-platform llm-security jailbreak-prompts adversarial-prompts ai-safety red-teaming prompt-injection chatgpt research-dataset huggingface-dataset llm-evaluation ccs-2024 content-safety natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="verazuo/jailbreak_llms")