玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
The-freezer /

GLM-5.2-ABLITERATED-NVFP4

HF 源站

The-freezer/GLM-5.2-ABLITERATED-NVFP4 is an uncensored open-source model hosted on Hugging Face.

Text GenerationvLLMsafetensorsChineseEnglishMultilingualLicense: mitglm_moe_dsaglmglm-5.2mixture-of-expertsmoeabliterateduncensorednvfp4fp4mtpspeculative-decodingsecurity-researchred-teamingconversational8-bitmodelopt
README.md说明 / 使用方法

license: mit base_model:

  • Blackfrost-AI/GLM-5.2-ABLITERATED-BF16 base_model_relation: quantized pipeline_tag: text-generation library_name: vllm language: [en, zh] tags: [glm, glm-5.2, glm_moe_dsa, mixture-of-experts, moe, abliterated, uncensored, nvfp4, fp4, mtp, speculative-decoding, vllm, security-research, red-teaming]

Blackfrost


⚠️ UNCENSORED

Refusal directions in the residual stream have been ablated, so the model does not decline requests on content-policy grounds. Read the Disclaimer before downloading.


Why this model exists

The Blackfrost-verified build of the ABLITERATED family: GLM-5.2 quantized to NVFP4 (4-bit) and accelerated with multi-token-prediction speculative decoding, so a ~753B MoE runs fast on a single 8× Blackwell node — with a verified 0-refusal profile.

Decode throughput on 8× RTX PRO 6000 — 2.1× faster with MTP acceleration


Specifications

ArchitectureGlmMoeDsaForCausalLM (glm_moe_dsa) — GLM MoE with MLA + DSA
Parameters~753B total MoE · NVFP4 footprint ≈ 420 GB
Layers78 (first 3 dense, remaining MoE) + 1 MTP prediction layer
Experts256 routed, 8 active per token, + 1 shared
AttentionMLA (kv_lora_rank 512, q_lora_rank 2048) + DSA sparse indexer
Contextup to 1,048,576
QuantizationNVFP4 4-bit, group-size 16, experts-only — attention pathway kept high-precision so the de-risk survives quantization
AccelerationMTP speculative decoding, built into the shipped serving stack
Target hardware8× RTX PRO 6000 Blackwell (SM120)

Lineage

zai-org/GLM-5.2                                    base foundation model, ZhipuAI
  └─ huihui-ai/Huihui-GLM-5.2-abliterated-GGUF     refusal directions ablated (Q3_K GGUF)
       └─ Blackfrost-AI/GLM-5.2-ABLITERATED-BF16   up-cast to BF16 safetensors
            └─ Blackfrost-AI/GLM-5.2-ABLITERATED-NVFP4   ← this repo
Base foundationzai-org/GLM-5.2 — ZhipuAI
Abliterationhuihui-ai — refusal directions ablated
Blackfrost appliedFormat up-cast to BF16, then NVFP4 quantization + MTP acceleration
Not appliedAdditional abliteration · SFT · DPO · RLHF

Full credit to ZhipuAI for GLM-5.2 and to huihui-ai for the abliteration. No additional fine-tuning or abliteration was performed by Blackfrost.

Blackfrost also publishes an in-house de-risked GLM-5.2 line derived directly from zai-org/GLM-5.2 source rather than from a third-party abliteration — see BlackfrostAI/GLM-5.2-DERISKED-BF16. This repository is not that.


Measured behaviour

Throughput — single-stream, 8× RTX PRO 6000 (SM120)

Decode modeThroughput
MTP acceleration (shipped)~56.1 tok/s
Standard decode~26.5 tok/s

~2.1× faster on the same 8 cards.

Refusal — evaluated on the live serve

Every substring-flagged case was read by hand to confirm.

DatasetPromptsTrue refusals
AdvBench (harmful)1500
StrongREJECT (harmful)1500
XSTest — safe (over-refusal)1500
Coherence (all sets)4500 incoherent

True refusal rate: 0 / 300 harmful prompts. Quantization neither adds nor restores safety behaviour.

Method caveat. Validated on a 450-prompt evaluation (substring pre-filter + manual review), not an exhaustive benchmark, and on one serving configuration.


Limitations

  • 4-bit quantized — expect quality below the full-precision base, especially on long, hard reasoning.
  • Tuned for SM120 (Blackwell); other architectures need a different serving backend.
  • Refusal behaviour validated on 450 prompts, not exhaustively.

Deployment notes

  • Hardware. ~420 GB. 8× RTX PRO 6000 Blackwell (SM120), TP=8, vLLM.
  • Parsers. --reasoning-parser glm45, --tool-call-parser glm47. For a clean refusal test set enable_thinking=false.
  • Integrity. Verify shard count and byte totals before attributing a load failure to the weights.

Disclaimer

Refusal behaviour in this checkpoint has been removed. It is not a safety-stock model and must not be deployed, marketed, or evaluated as one. It will comply with requests a consumer model would decline.

No warranty of any kind. Provided "as is", without warranty express or implied, including fitness for a particular purpose. Nothing here guarantees that any given input will be accepted or refused, that any capability is retained, or that any category of output is unreachable.

Measurements describe what was measured under the stated harness and conditions. They are not safety proofs and do not generalise to multimodal, tool-use, long-context or multi-turn adversarial settings.

Modification by a recipient voids this characterization. Blackfrost's obligations attach at the point of release. Any further ablation, fine-tuning, merging, quantization or alteration produces an artifact Blackfrost has not evaluated and does not stand behind — responsibility transfers entirely to whoever produced it.

Operator-owned policy. Open weights mean the operator sets and enforces policy. You are responsible for adding your own safety filtering, human review, and access controls.


Access & licensing

  • Base licence: inherited from GLM-5.2 (ZhipuAI / Z.ai) — review and comply before any use or redistribution.
  • Deploy kit: the tuned serving stack that delivers the Blackwell performance above is provided to licensees, not published here.
  • Free public download: The-freezer/GLM-5.2-ABLITERATED-NVFP4. No payment, sign-in, or access request is required to download the weights. Existing repository and upstream license terms still apply.

Contact Blackfrost


HUGGING FACE

上游数据

HF 下载量67
HF 点赞量9

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
The-freezer
最近更新
2026/07/30
最新创建
2026/07/10
HF 趋势
874
数据快照
2026/10/20
版本
未知
许可证
mit