Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

base_model:

• huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated base_model_relation: quantized tags:
• qwen
• qwen2.5
• vision-language
• split
• nvfp4
• fp16
• quantization
• art license: apache-2.0 language:
• en

Combined NVFP4 Encoder

• Qwen25VL7B_nvfp4_fixedBF16.safetensors - Replaced uint8 (152064, 1792) (lm_head.weight)lm_head and (model.embed_tokens.weight)nn.Embedding with BF16 (152064, 3584). works in comfy

note: Havent done in depth testing

• Qwen25VL7B_nvfp4_simple_raw.safetensors - has uint8 (152064, 1792) (lm_head.weight)lm_head and (model.embed_tokens.weight)nn.Embedding. comfy wont load this

Split NVFP4 Encoders

• has uint8 (152064, 1792) lm_head and nn.Embedding. comfy wont load these
• split_files/text_encoders/qwen_2.5_vl_7b_text_nvfp4_simple.safetensors - Text encoder
• split_files/vision_encoders/qwen_2.5_vl_7b_vision_nvfp4_simple.safetensors - Vision encoder

note: Still working on mixed layers but