玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
marafx2025 /

Qwen3.6-27B-Abliterated-Heretic-Uncensored-GGUF

HF 源站

marafx2025/Qwen3.6-27B-Abliterated-Heretic-Uncensored-GGUF is an uncensored open-source model hosted on Hugging Face.

Text GenerationGGUFLicense: apache-2.027Bqwenqwen3.6qwen3_5densemultimodalvlmvisionvideoimage-text-to-textabliterateduncensoredhereticmpoallama-cppsomaconversational
README.md说明 / 使用方法

base_model: Qwen/Qwen3.6-27B library_name: gguf pipeline_tag: text-generation license: apache-2.0 tags:

  • gguf
  • qwen
  • qwen3.6
  • qwen3_5
  • dense
  • multimodal
  • vlm
  • vision
  • video
  • image-text-to-text
  • abliterated
  • uncensored
  • heretic
  • mpoa
  • llama-cpp
  • soma quantized_by: Youssofal

Qwen3.6-27B-Abliterated-Heretic-Uncensored-GGUF

This is a GGUF release of an abliterated, uncensored version of Qwen's Qwen3.6-27B, made with Heretic.

By applying a Heretic-style MPOA pipeline with magnitude preservation on the Qwen3.6-27B dense text stack, the base refusal behavior was removed at the weight level with extremely low distributional divergence (KL 0.0251 vs base on harmless prompts). The text GGUFs are paired with Qwen3.6-27B vision projectors (mmproj) so image/video-capable llama.cpp and LM Studio runtimes can use the multimodal path.

Quick Benchmarks

CheckOriginal Qwen3.6-27BAbliterated Heretic Uncensored
Official 25-prompt refusal check20/25 refusals1/25 refusals
100-prompt refusal check92/100 refusals3/100 refusals
KL divergenceN/A0.0251

Methodology & Model Notes

Qwen3.6-27B is a 27.8B dense vision-language model with 64 text layers, hybrid linear/full attention (3 linear-attention + 1 full-attention per 4-layer group), and an integrated image + video vision tower.

This release was produced with a direct Heretic-style MPOA run with magnitude preservation — output-side orthogonalization on self_attn.o_proj, linear_attn.out_proj, and mlp.down_proj, with each weight row/column's L2 norm restored after projection. The ablation direction is interpolated at direction_index = 37.97.

The accepted candidate scored Refusals: 1/25 on the official 25-prompt marker suite used for the MiniMax M2.7 and Qwen3.6-35B-A3B abliterated runs, with a measured KL divergence of 0.0251 against the base on mlabonne/harmless_alpaca test[:25].

The resulting abliterated checkpoint was exported to BF16 and then converted to GGUF for llama.cpp-compatible deployment. The language GGUF files are text-model files; multimodal input is enabled by loading a matching mmproj projector alongside them.

Files

  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-BF16-00001-of-00002.gguf + -00002-of-00002.gguf: BF16 GGUF source (split; use with --load-tensors or llama-gguf-split --merge)
  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-Q8_0.gguf: highest-fidelity quant
  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-Q6_K.gguf: near-lossless practical quant
  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-Q5_K_M.gguf: high-fidelity medium quant
  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-Q4_K_M.gguf: smaller general-use quant
  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-Q3_K_M.gguf: compact quant
  • Qwen3.6-27B-Abliterated-Heretic-Uncensored-Q2_K.gguf: smallest-footprint quant
  • mmproj-F16.gguf / mmproj-model-f16.gguf: F16 Qwen3.6-27B vision projector for LM Studio and llama.cpp multimodal loading
  • mmproj-BF16.gguf / mmproj-model-bf16.gguf: BF16 Qwen3.6-27B vision projector

Running

llama-server \
  -m <quant-file.gguf> \
  -ngl 999 -c 32768 --jinja -fa

For image/video-capable runtimes, load the projector with the text GGUF:

llama-server \
  -m <quant-file.gguf> \
  --mmproj mmproj-model-f16.gguf \
  -ngl 999 -c 32768 --jinja -fa

Model Architecture

SpecValue
Total Parameters27.8B (dense)
Layers64
AttentionHybrid (3 linear-attention + 1 full-attention per 4-layer group)
Hidden Size5120
Familyqwen3_5
ModalityVision-language via GGUF text model + Qwen3.6-27B mmproj
Base ModelQwen/Qwen3.6-27B

Disclaimer

This model has had refusal behavior removed at the weight level. It will answer prompts that the base model would normally refuse. You are responsible for how you use it.

Credits

  • Base model: Qwen/Qwen3.6-27B
  • Refusal removal pipeline: Heretic
  • GGUF runtime and quantization: llama.cpp

License

This release inherits the base Qwen3.6-27B license.

Apache-2.0.

HUGGING FACE

上游数据

HF 下载量905
HF 点赞量0

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
marafx2025
最近更新
2026/04/27
最新创建
2026/04/27
HF 趋势
未知
数据快照
2026/09/16
版本
未知
许可证
apache-2.0