inference: false library_name: transformers language:
- en
- fr
- de
- es
- it
- pt
- ja
- ko
- zh
- ar
- el
- fa
- pl
- id
- cs
- he
- hi
- nl
- ro
- ru
- tr
- uk
- vi license: cc-by-nc-4.0 base_model:
- CohereForAI/aya-expanse-8b tags:
- gguf
- CohereForAI
aya-expanse-8b-abliterated GGUF Quantized Models
Technical Details
- Quantization Tool: llama.cpp
- Version: version: 5427 (f7c9429c)
Model Information
- Base Model: lenML/aya-expanse-8b-abliterated
- Quantized by: matrixportal
Available Files
| 🚀 Download | 🔢 Type | 📝 Description |
|---|---|---|
| Download | Q4 K M | 4-bit balanced (recommended default) |
💡 Q4 K M provides the best balance for most use cases