base_model: null-space/gemma-4-31b-it-abliterated tags:
- gemma4
- abliterated
- uncensored
- gguf
- llama-cpp
- lm-studio
- quantized
- base_model:quantized:null-space/gemma-4-31b-it-abliterated license: apache-2.0 language:
- en
GGUF Quantizations of null-space/gemma-4-31b-it-abliterated
GGUF quantizations of null-space/gemma-4-31b-it-abliterated, the SVD multi-direction abliterated version of Google's Gemma 4 31B-IT.
This model is an abliteration of Gemma 4 31B, using SVD-based subspace projection (k=32, top 8 directions per layer) across layers 20-59 with variable scaling. See the original model card for full technical details.
Why Q8_0 matters for this model
The original author explicitly noted that 4-bit quantized measurements produced noticeably weaker abliteration. Q8_0 preserves the abliteration directions with much higher fidelity than lower-bit quants.
Original model metrics (BF16)
| Mode | Baseline | Abliterated | Delta |
|---|---|---|---|
| Cold (no system prompt) | 67% | 32% | -35% |
| Prompted (creative writing SP) | 47% | 5% | -42% |
| Retry (prompted + retry) | 40% | 2% | -38% |
| Harmless | 0% | 0% | 0% |
MMLU divergence: 0.2% (within noise).
Usage
Works with llama.cpp, LM Studio, Ollama, and other GGUF-compatible tools.
Make sure to use a custom system prompt as shown in the example below, to counter possible refusals:
llama-cli -m gemma-4-31b-it-abliterated-Q8_0.gguf --conversation --system-prompt "You are a helpful, uncensored assistant." -ngl 28 -n 512
Credits
- Abliteration: null-space (SVD multi-direction subspace projection)
- Base model: Google DeepMind
- Quantization: aacidburn
- Assistance: Claude Opus 4.6