返回模型目录
chplushsieh /

Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit

HF 源站

chplushsieh/Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit is an uncensored open-source model hosted on Hugging Face.

Text GenerationsafetensorsLicense: llama38Btransformersllamaconversationaltext-generation-inference4-bitgptq
README.md说明 / 使用方法

license: llama3 library_name: transformers

Description

This is a 4-bit GPTQ quantized model of failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 It is quantized with wikitext2 dataset. Its file size is 5.73 GB, and can fit into a 8GB VRAM GPU.