返回模型目录
josephmayo /

Mellum2-12B-A2.5B-Thinking-Abliterated-GGUF

HF 源站

josephmayo/Mellum2-12B-A2.5B-Thinking-Abliterated-GGUF is an uncensored open-source model hosted on Hugging Face.

Text GenerationGGUF12Babliteratedmellum2moe
README.md说明 / 使用方法

base_model: josephmayo/Mellum2-12B-A2.5B-Thinking-Abliterated library_name: gguf pipeline_tag: text-generation tags:

  • gguf
  • abliterated
  • mellum2
  • moe

Mellum2-12B-A2.5B-Thinking-Abliterated - GGUF

GGUF quantizations of josephmayo/Mellum2-12B-A2.5B-Thinking-Abliterated, an abliterated build of JetBrains Mellum2-12B-A2.5B-Thinking (64-expert MoE, top-8 active).

Produced with llama.cpp (commit 63e66fdd23eda3a2659a7af9ff6ef15d71efbff1), static quants (no imatrix).

QuantNotesSize (GB)
Q8_0standard12.93
Q6_Kstandard10.88
Q4_K_LQ4_K_M body + Q8_0 embed/output (bartowski-style)8.24

Disclaimer

Research artifact only. Not for harmful use.