返回模型目录
diverofdark /

Huihui-Qwen3.8-27B-abliterated-nf4

HF 源站

diverofdark/Huihui-Qwen3.8-27B-abliterated-nf4 is an uncensored open-source model hosted on Hugging Face.

safetensorsLicense: apache-2.027Bqwen3_5bitsandbytes4-bitnf4
README.md说明 / 使用方法

license: apache-2.0 base_model: huihui-ai/Huihui-Qwen3.8-27B-abliterated tags:

  • bitsandbytes
  • 4-bit
  • nf4

Huihui-Qwen3.8-27B-abliterated, bitsandbytes NF4

huihui-ai/Huihui-Qwen3.8-27B-abliterated at commit 739e3c5b89849f6c238ce1e5b70008612ae42cdd, vision tower included, quantized by transformers' BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16) and written with save_pretrained. 19 GB against the original's 52 GB.

The tokenizer, chat template and processor files are the original commit's, unchanged.