玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
Youssofal /

Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit

HF 源站

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit is an uncensored open-source model hosted on Hugging Face.

Text GenerationMLX LMsafetensorsLicense: apache-2.035Bmlxqwen3_5_moeqwenqwen3.6moemixture-of-expertsmultimodalvlmvisionvideoimage-text-to-textabliterateduncensoredhereticmpoasomaapple-silicon4-bitconversational
README.md说明 / 使用方法

base_model: Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-BF16 library_name: mlx pipeline_tag: text-generation license: apache-2.0 tags:

  • mlx
  • mlx-lm
  • qwen
  • qwen3.6
  • qwen3_5_moe
  • moe
  • mixture-of-experts
  • multimodal
  • vlm
  • vision
  • video
  • image-text-to-text
  • abliterated
  • uncensored
  • heretic
  • mpoa
  • soma
  • apple-silicon
  • 4-bit quantized_by: Youssofal

Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit

This is an MLX release of an abliterated version of Qwen's Qwen3.6-35B-A3B.

By applying Heretic's ablation pipeline to the text-side MoE stack, the base refusal behavior was removed at the weight level. This release keeps the Qwen3.6-35B-A3B reasoning and instruction-following profile in Apple MLX format for local deployment on Apple Silicon hardware.

This MLX repo includes the retained Qwen3.6 image/video processor files and vision tower tensors for runtimes with Qwen3.6 multimodal MLX support.

Quick Benchmarks

CheckOriginal Qwen3.6-35B-A3BAbliterated Heretic MLX
Official 25-prompt refusal check22/25 refusals3/25 refusals
Archived Heretic KL divergence-0.010655362159013748

Methodology & Model Notes

Qwen3.6-35B-A3B is a sparse MoE model in the qwen3_5_moe family. The accepted abliterated BF16 source checkpoint was produced with a Heretic MPOA/SOMA-style sibling-transfer workflow and finalized with the input-side split-MoE intervention that cleared the official 25-prompt refusal marker suite down to 1/25.

This MLX release was built directly from the published BF16 Heretic checkpoint using a high-quality layer-aware quantization policy instead of a flat per-weight pass.

  • quant target: 4-bit
  • quant build: 4-bit high-quality mixed layer-aware quantization (4/6-bit)
  • source checkpoint: Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-BF16
  • published variant: Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit

The layer-aware policy keeps more precision on sensitive projections in the early, late, and selected middle layers so the quant stays cleaner than a naive flat conversion.

Validation

This published MLX variant passed:

  • the official 25-prompt refusal marker check in standard thinking-enabled chat format: 3/25 refusals
  • the local smoke suite for general chat, short reasoning, and short code output: all_looks_ok=true

Running

from mlx_lm import load, generate

model, tokenizer = load("Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit")

messages = [{"role": "user", "content": "Write a short Python function that reverses a string."}]
prompt = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
)

response = generate(model, tokenizer, prompt=prompt, max_tokens=256)
print(response)

Files

The repo root contains the complete 4-bit MLX export for this variant:

  • config.json
  • model.safetensors.index.json
  • split quantized text model-*.safetensors shards
  • model-vision-00001-of-00001.safetensors
  • tokenizer, generation, and processor files
  • README.md

Credits

  • Base model: Qwen/Qwen3.6-35B-A3B
  • BF16 abliterated source: Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-BF16
  • Apple Silicon runtime: mlx-lm
  • Refusal-removal pipeline: Heretic

Disclaimer

This model has had refusal behavior removed at the weight level. It will answer prompts that the base model would normally refuse. You are responsible for how you use it.

HUGGING FACE

上游数据

HF 下载量1995
HF 点赞量20

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
Youssofal
最近更新
未知
最新创建
2026/04/16
HF 趋势
902
数据快照
2026/09/16
版本
未知
许可证
apache-2.0