base_model: nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B base_model_relation: quantized quantized_by: ArtusDev library_name: transformers tags:
- awq
- mergekit
- merge license: apache-2.0 language:
- zho
- eng
- fra
- spa
- por
- deu
- ita
- rus
- jpn
- kor
- vie
- tha
- ara
AWQ Quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B
AWQ quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B using AutoAWQ for quantization.
Model was quantized down to INT4 using GEMM kernels, with zero-point quantization and a group size of 128.