thu-coai/Safety-Prompts resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1214 stars · 89 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A dataset of 100k Chinese safety prompts with ChatGPT responses covering typical unsafe scenarios and instruction attacks, for evaluating and improving LLM safety. It accompanies the paper 'Safety Assessment of Chinese Large Language Models' from Tsinghua's thu-coai group.

Use cases

• evaluate the safety of a Chinese LLM
• fine-tune a model to refuse unsafe requests
• test robustness against prompt injection and jailbreak attacks
• align model outputs with human values
• build a safety benchmark for Chinese chatbots
• research instruction attack categories like goal hijacking and prompt leaking

When to choose

• you need large-scale Chinese-language safety training or evaluation data
• you want to test LLM robustness against Chinese instruction attacks
• you are aligning a Chinese chatbot with safety norms

When to avoid

• you need English-language safety data
• you want multiple-choice safety benchmarking - use the authors' SafetyBench instead
• you need a ready-made safety detector - use the authors' ShieldLM instead

Facets

dataset · maturity stable

prompt-engineering machine-learning llm-training security large-language-models security artificial-intelligence python cross-platform llm-safety chinese-language safety-evaluation instruction-attacks alignment benchmark fine-tuning-data natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="thu-coai/Safety-Prompts")