返回模型目录

azminawwar /

Huihui-Qwen3.5-0.8B-abliterated-claude_mythos_distilled_25k

azminawwar/Huihui-Qwen3.5-0.8B-abliterated-claude_mythos_distilled_25k is an uncensored open-source model hosted on Hugging Face.

Unsloth Desktop llama.cpp GGUF 0.8B qwen3_5 vision-language-model conversational

README.md说明 / 使用方法

tags:

gguf
llama.cpp
unsloth
vision-language-model

Huihui-Qwen3.5-0.8B-abliterated-claude_mythos_distilled_25k : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Base on this Model and Dataset: https://huggingface.co/huihui-ai/Huihui-Qwen3.5-0.8B-abliterated https://huggingface.co/datasets/WithinUsAI/claude_mythos_distilled_25k

Example usage:

For text only LLMs: llama-cli -hf azminawwar/Huihui-Qwen3.5-0.8B-abliterated-claude_mythos_distilled_25k --jinja
For multimodal models: llama-mtmd-cli -hf azminawwar/Huihui-Qwen3.5-0.8B-abliterated-claude_mythos_distilled_25k --jinja

Available Model files:

Huihui-Qwen3.5-0.8B-abliterated.Q2_K_L.gguf
Huihui-Qwen3.5-0.8B-abliterated.F16.gguf
Huihui-Qwen3.5-0.8B-abliterated.BF16.gguf
Huihui-Qwen3.5-0.8B-abliterated.Q8_0.gguf
Huihui-Qwen3.5-0.8B-abliterated.Q6_K.gguf
Huihui-Qwen3.5-0.8B-abliterated.Q3_K_M.gguf
Huihui-Qwen3.5-0.8B-abliterated.Q5_K_M.gguf
Huihui-Qwen3.5-0.8B-abliterated.Q4_K_M.gguf
Huihui-Qwen3.5-0.8B-abliterated.F16-mmproj.gguf This was trained 2x faster with Unsloth