library_name: gguf license: mit license_link: https://huggingface.co/inclusionAI/Ling-3.0-flash pipeline_tag: text-generation tags:
- ling
- moe
- hybrid
- reasoning
- abliterated
- abliterix
- apex
- quantization
- gguf
- bailingmoe3
- inclusionAI base_model:
- inclusionAI/Ling-3.0-flash base_model_relation: quantized
./llama-server
-m ./models/Ling-3.0-flash-abliterated-APEX-Compact.gguf
--port 8080
-sm none
--flash-attn on
--fit on
--ctx-size 32768
--reasoning off
--jinja
--host 0.0.0.0
Links
- Original model: https://huggingface.co/inclusionAI/Ling-3.0-flash
- inclusionAI: https://huggingface.co/inclusionAI
- ModelScope: https://modelscope.cn/organization/inclusionAI
- OpenRouter: https://openrouter.ai/inclusionai/ling-3.0-flash:free
- abliterix: https://github.com/wuwangzhang1216/abliterix
- APEX: https://github.com/mudler/apex-quant
- llama.cpp PR #26608 (bailingmoe3, merged 2026-08-17, first release b10470): https://github.com/ggml-org/llama.cpp/pull/26608
Disclaimer
Community derivative (behavior edit + quantization). Not an official inclusionAI release. Use at your own risk; follow local law and the upstream MIT license.