玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
r3lax /

Huihui-Ornith-1.5-35B-A3B-abliterated-MTPLX-mixed8-4bit-FP16

HF 源站

r3lax/Huihui-Ornith-1.5-35B-A3B-abliterated-MTPLX-mixed8-4bit-FP16 is an uncensored open-source model hosted on Hugging Face.

Text GenerationMLX LMsafetensorsLicense: mit35Bmlxqwen3_5_moemtplxqwen3-moeornithabliterateduncensoredfp16apple-siliconconversational4-bit
README.md说明 / 使用方法

license: mit base_model: huihui-ai/Huihui-Ornith-1.5-35B-A3B-abliterated tags:

  • mlx
  • mtplx
  • qwen3-moe
  • ornith
  • abliterated
  • uncensored
  • fp16
  • apple-silicon pipeline_tag: text-generation

Huihui Ornith 1.5 35B A3B Abliterated — MTPLX mixed 8/4-bit FP16

MTPLX (native MTP speculative decoding on Apple Silicon) forge of huihui-ai/Huihui-Ornith-1.5-35B-A3B-abliterated, itself an abliterated (refusal-removed, layers 11–29) uncensored build of ornith-ai/Ornith-1.5-35B-A3B.

Quant recipe (stolen from the attention8 Ornith forge, fp16 lane)

  • body: 4-bit affine, group 32 — MoE experts (bulk, sparse-active)
  • 8-bit affine, group 64: all linear_attn projections, all self_attn q/k/v/o, mlp.gate, mlp.shared_expert_gate, lm_head, embed_tokens
  • trunk dtype fp16 + MTP sidecar fp16 — the fast native path on M1/M2 Macs, which have no native BF16. Runs fine on M3+ too.

Measured on M1 Max 64GB

modetok/svs AR
AR51.11.00x
D168.21.34x
D274.81.46x
D373.31.44x

Tuned best: D2 (74.0 t/s, 1.49x). Profile: sustained.

Use

mtplx serve --model r3lax/Huihui-Ornith-1.5-35B-A3B-abliterated-MTPLX-mixed8-4bit-FP16 --download

License: MIT (matches source). Forged with MTPLX 2.11.2.

HUGGING FACE

上游数据

HF 下载量0
HF 点赞量1

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
r3lax
最近更新
2026/09/25
最新创建
2026/09/25
HF 趋势
824
数据快照
2026/09/25
版本
未知
许可证
mit