Sumandora/remove-refusals-with-transformers

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2149 stars · 322 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A proof-of-concept Python script that removes refusal behavior from LLMs by ablating the refusal direction using pure Hugging Face Transformers, without requiring TransformerLens. It computes the refusal direction from harmful/harmless instruction datasets and applies it during inference.

Use cases

• remove refusals from an LLM without TransformerLens
• ablate the refusal direction in any HF Transformers model
• study how refusal is mediated by a single direction in LLMs
• test refusal removal on small models with limited GPU memory
• compare refusal behavior before and after direction ablation

When to choose

• you want to experiment with refusal-direction ablation using only Hugging Face Transformers
• your model isn't supported by TransformerLens
• you're doing interpretability or safety research on consumer GPUs with small models

When to avoid

• you need a production-ready or maintained tool rather than a proof of concept
• your model uses a custom layer structure like some Qwen implementations
• you need broad model compatibility guarantees or extensive documentation

Facets

library · maturity experimental

llm-inference machine-learning deep-learning large-language-models machine-learning artificial-intelligence python windows refusal-direction transformerlens-alternative model-ablation safety-research proof-of-concept huggingface-transformers gpu linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Sumandora/remove-refusals-with-transformers")