返回模型目录
NexesQuants /

Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF

HF 源站

NexesQuants/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF is an uncensored open-source model hosted on Hugging Face.

llama.cppGGUFLicense: llama3.370Bik_llama.cppconversational
README.md说明 / 使用方法

license: llama3.3 base_model:

  • NexesMess/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10 tags:
  • ik_llama.cpp

about:

Q8_0 and Q5_0_custom static quants for this merge. Also, an overall 4.8bpw quant for IK_Llama.cpp and Croco.cpp, targetting 48GB VRAM users.