base_model: openbmb/MiniCPM5-2B base_model_relation: quantized license: apache-2.0 library_name: gguf pipeline_tag: text-generation language:
- en
- zh tags:
- gguf
- llama-cpp
- quantization
- minicpm
- minicpm5
- fit-gguf
- uncensored
- abliterated
- on-device
./llama-cli
-m minicpm5-2b-abliterated-FIT-QUALITY-1.46GiB-Q4_K_M.gguf
-ngl 99 -c 4096 -p "Hello" -n 256The chat template is embedded in every file — including the tool-calling and reasoning-content handling — so LM Studio, KoboldCpp, Jan and friends load them without extra configuration. This is a dense 2.5B text model: no vision projector, no MTP head, no MoE. The full 131,072-token context is available, but KV cache grows with it; start at -c 8192 and work up.