DeepSeek-R1-Distill-Llama-8B-abliterated-w4a16g128asym

language:

• en license: llama3.1 base_model: huihui-ai/DeepSeek-R1-Distill-Llama-8B-abliterated base_model_relation: quantized library_name: mlc-llm pipeline_tag: text-generation

4-bit OmniQuant quantized version of DeepSeek-R1-Distill-Llama-8B-abliterated for inference with the Private LLM app.