玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
richardyoung /

Qwen3-14B-abliterated-GGUF

HF 源站

richardyoung/Qwen3-14B-abliterated-GGUF is an uncensored open-source model hosted on Hugging Face.

Text GenerationOllamaGGUFEnglishLicense: apache-2.014Babliterateduncensoredqwen3llama-cpplm-studioquantizedconversational
README.md说明 / 使用方法

license: apache-2.0 base_model: Qwen/Qwen3-14B tags:

  • abliterated
  • uncensored
  • qwen3
  • gguf
  • llama-cpp
  • ollama
  • lm-studio
  • quantized pipeline_tag: text-generation language:
  • en

Qwen3-14B Abliterated (GGUF)

An abliterated (uncensored) version of Qwen/Qwen3-14B in GGUF format for local inference.

Abliteration Results

MetricValue
Base Refusals97/100
Abliterated Refusals19/100
Refusal Reduction80%
KL Divergence0.98

Conservative abliteration preserves model coherence while significantly reducing refusals.

Quick Start

With Ollama

ollama run hf.co/richardyoung/Qwen3-14B-abliterated-GGUF

With llama.cpp

huggingface-cli download richardyoung/Qwen3-14B-abliterated-GGUF \
    --include "*Q4_K_M*" --local-dir ./models

./llama-cli -m ./models/*Q4_K_M*.gguf \
    -p "You are a helpful assistant." \
    --chat-template chatml -ngl 99

With Python (llama-cpp-python)

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="richardyoung/Qwen3-14B-abliterated-GGUF",
    filename="*Q4_K_M*",
    n_gpu_layers=-1,
)

output = llm.create_chat_completion(
    messages=[{"role": "user", "content": "Explain abliteration in simple terms."}]
)
print(output["choices"][0]["message"]["content"])

Available Quantizations

QuantizationUse Case
Q4_K_MRecommended — good balance
Q5_K_MHigher quality
Q8_0Maximum quality

What is Abliteration?

Abliteration removes the "refusal direction" from a model's residual stream — a surgical modification that disables safety refusals without retraining. See Refusal in Language Models Is Mediated by a Single Direction.

Intended Use

Research, creative writing, education on alignment techniques, and unrestricted local inference.

Other Models by richardyoung

  • Abliterated/Uncensored models: Qwen2.5-7B | Qwen3-14B | DeepSeek-R1-32B | Qwen3-8B
  • MLX quantizations (Apple Silicon): Kimi-K2 series | olmOCR MLX
  • OCR & Vision: olmOCR GGUF
  • Healthcare/Medical: Synthea 575K patients dataset | CardioEmbed
  • Research: LLM Instruction-Following Evaluation (arxiv:2510.18892)
HUGGING FACE

上游数据

HF 下载量9371
HF 点赞量9

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
richardyoung
最近更新
未知
最新创建
2025/12/01
HF 趋势
未知
数据快照
2026/09/16
版本
未知
许可证
apache-2.0