玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
RobinsonLabs /

Qwen3.5-122B-A10B-REAP-20-abliterated-GGUF

HF 源站

RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated-GGUF is an uncensored open-source model hosted on Hugging Face.

Text GenerationGGUFLicense: apache-2.0122Babliteratedqwen3.5moereapnot-for-all-audiencesimatrixconversational
README.md说明 / 使用方法

license: apache-2.0 base_model: 0xSero/Qwen3.5-99B library_name: gguf pipeline_tag: text-generation tags:

  • gguf
  • abliterated
  • qwen3.5
  • moe
  • reap
  • not-for-all-audiences

Qwen3.5-122B-A10B-REAP-20 - Abliterated GGUF

Abliterated, importance-matrix (imatrix) quantized GGUFs of 0xSero/Qwen3.5-99B - 0xSero's ~20% MoE expert-prune (REAP) of Qwen/Qwen3.5-122B-A10B, taking the model from 122B down to ~99B parameters (205 of 256 experts kept) while keeping the A10B active-expert budget and the qwen35moe architecture. Robinson Labs then abliterated the pruned model and quantized it here.

This is the lighter-prune sibling of the REAP-30 build: 20% of experts removed instead of 30%, so it keeps more of the original model's capacity at a larger footprint. Like the REAP-30 variant it has no Multi-Token Prediction (MTP / NextN): the upstream config declared a phantom nextn layer carrying no weights, so our convert produced a clean 48-layer model (block_count=48). These are standard single-token-prediction GGUFs.

A full-precision bf16 safetensors base for re-abliteration, LoRA merge, fine-tune, or rolling your own quants is at RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated.

Disclosure

This model is abliterated - the hard-refusal reflex on adult / creative content has been reduced via single-direction weight orthogonalization. Harm guardrails are retained by design: self-harm prompts still redirect to help (e.g. 988), and it is not intended to assist genuine wrongdoing. Capability is preserved. Tagged not-for-all-audiences. Use responsibly - you are responsible for your use. License inherited from the base model: Apache-2.0.

Files

FileQuantSizeNotes
Qwen3.5-122B-A10B-REAP-20-abliterated-Q6_K.ggufQ6_K81.3 GBnear-lossless
Qwen3.5-122B-A10B-REAP-20-abliterated-Q5_K_M.ggufQ5_K_M70.4 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-Q4_K_M.ggufQ4_K_M60.2 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-Q4_K_S.ggufQ4_K_S56.5 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-IQ4_XS.ggufIQ4_XS53.2 GBquality/size sweet spot
Qwen3.5-122B-A10B-REAP-20-abliterated-Q3_K_M.ggufQ3_K_M47.6 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-IQ3_M.ggufIQ3_M43.7 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-IQ3_XS.ggufIQ3_XS40.9 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-IQ2_M.ggufIQ2_M32.8 GB
Qwen3.5-122B-A10B-REAP-20-abliterated-IQ2_XS.ggufIQ2_XS29.5 GBsmallest

All quants are imatrix-weighted (generic calibration). This is the REAP-pruned 48-layer model - no MTP block.

Quant ladder - bits-per-weight vs file size

Method

  • Expert prune (REAP): ~20% of the MoE experts removed by 0xSero's REAP method, 122B -> ~99B params (205 of 256 experts), qwen35moe arch, A10B active budget retained.
  • Abliteration: single mid-layer refusal direction removed via weight orthogonalization on the bf16 pruned base; routers preserved. No MTP/NextN block exists in this variant.
  • Quant: importance-matrix (imatrix) weighted convert + quantize with llama.cpp. The imatrix uses a generic calibration set (bartowski calibration_datav3) - a broad, domain-agnostic fit.

bf16 base

The full-precision bf16 safetensors base for this ladder is RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated

  • the master for further surgery (re-abliteration, LoRA merge, fine-tune) and for making your own quants. The upstream REAP parent is 0xSero/Qwen3.5-99B.

Provenance

Qwen3.5-122B-A10B (Apache-2.0) -> REAP-20 expert-prune (0xSero) -> abliterated bf16 (Robinson Labs) -> generic-imatrix GGUF quants.

HUGGING FACE

上游数据

HF 下载量341
HF 点赞量2

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
RobinsonLabs
最近更新
2026/06/29
最新创建
2026/06/29
HF 趋势
未知
数据快照
2026/09/17
版本
未知
许可证
apache-2.0