00 // The Guides
The Complete n00b's Guide to Abliteration
The mental model, no terminal required. Residual streams, the refusal direction, difference-in-means, and the two cuts: inference-time directional ablation vs permanent weight orthogonalization. What breaks, what survives, why the single-direction story is only mostly true.
GUIDE 2 · HANDS-ONAbliterate Your First Small Model
The doing-it guide. Two honest paths: the two-command easy way and the by-hand manual way that shows where every trap lives. Qwen2.5 or Qwen3, both eval axes, no skipped steps — plus the defender's side of the table.
GUIDE 3 · THE MATHThe n00b's Math Guide to Abliteration
The formulas behind every click, from zero: vectors & the residual stream, difference-in-means, projections, the rank-1 orthogonalization edit, cosine readouts, the two-signal audit, and the honest cost math. Prerequisite: can average a list of numbers.
01 // The Labs
02 // Sources
- Arditi et al., Refusal in Language Models Is Mediated by a Single Direction (NeurIPS 2024)
- mlabonne, Uncensor any LLM with abliteration (Hugging Face blog)
- FailSpy, abliterator (GitHub)
- Caleb Fahlgren, How Abliteration Works
- grimjim, Norm-Preserving Biprojected Abliteration (Hugging Face blog)
- Nous Research, llm-abliteration (GitHub)