base_model:

• huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated base_model_relation: quantized library_name: gguf pipeline_tag: text-generation tags:
• quantization
• qwen
• gguf
• qwen
• qwen3.5
• abliterated
• uncensored
• 4bit

Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M

GGUF 4bit conversion of huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated.

Example

llama-cli \
  -m path/to/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
  --n-gpu-layers all \
  --ctx-size 262144 \
  --flash-attn on