library_name: transformers pipeline_tag: image-text-to-text license: apache-2.0 base_model: orcarouter/Qwen3.8-27B-Uncensored base_model_relation: quantized tags:

• Qwen3.8
• nvfp4
• fp4
• w4a4
• compressed-tensors
• 1cat-vllm
• multimodal
• mtp

Qwen3.8-27B-Uncensored NVFP4 for 1Cat-vLLM

An all-transformer-linear NVFP4 W4A4 PTQ build of orcarouter/Qwen3.8-27B-Uncensored, exported in the compressed-tensors nvfp4-pack-quantized layout used by QUASAR-QAT/Qwen3.8-27B-QUASAR-NVFP4 and supported by 1CatAI/1Cat-vLLM.

• 496/496 transformer linears: NVFP4 W4A4, group size 16
• lm_head, token embeddings, vision tower, and MTP tensors: BF16
• Calibration: 256 UltraChat samples, maximum sequence length 2,048
• LLM Compressor revision: c8676edd2f6cddd0be2427f034825ca0d476fa72

This is post-training quantization, not QUASAR quantization-aware training. It matches the runtime/checkpoint layout but does not claim QUASAR's benchmark quality. See quantization-audit.json and calibration.json.

The source model has substantially reduced safety alignment. Use it only for lawful, controlled purposes and add suitable safeguards before deployment.