玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
Li101 /

Qwen3.5-35B-A3B-Uncensored-Aggressive-NVFP4

HF 源站

Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-NVFP4 is an uncensored open-source model hosted on Hugging Face.

Image-Text-to-TextsafetensorsChineseEnglishMultilingualLicense: apache-2.035Bqwen3_5_moeuncensoredqwen3.5moenvfp4compressed-tensorsllm-compressorvisionmultimodalconversational
README.md说明 / 使用方法

license: apache-2.0 tags:

  • uncensored
  • qwen3.5
  • moe
  • safetensors
  • nvfp4
  • compressed-tensors
  • llm-compressor
  • vision
  • multimodal language:
  • en
  • zh
  • multilingual pipeline_tag: image-text-to-text base_model: Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-safetensors quantized_by: Li101

Qwen3.5-35B-A3B-Uncensored-Aggressive-NVFP4

NVFP4 quantized version of Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-safetensors, which is the "Aggressive" uncensoring variant of Qwen/Qwen3.5-35B-A3B. Includes full vision encoder weights (BF16, unquantized).

Quantization Details

DetailValue
MethodNVFP4 (compressed-tensors)
Model size~23 GB (vs 67 GB BF16)
Language modelNVFP4 quantized
Visual encoderBF16 (unquantized, 333 tensors, 0.89 GB)
Excluded from quantizationlm_head, MoE gates, shared expert gates, linear attention layers, visual encoder

Calibration

  • Samples: 512 (256 from each dataset)
  • Datasets:
    • HuggingFaceH4/ultrachat_200k (train_sft split) — length-filtered (longest conversations selected)
    • nvidia/Nemotron-Post-Training-Dataset-v2 (chat split)
  • Max sequence length: 1024
  • All experts calibrated: moe_calibrate_all_experts=True

Usage with vLLM

Please use nightly vLLM for support.

vllm serve Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-NVFP4 \
    --kv-cache-dtype fp8 \
    --reasoning-parser qwen3 \
    --enable-auto-tool-choice \
    --tool-call-parser qwen3_coder

Specs

Same architecture and capabilities as Qwen/Qwen3.5-35B-A3B, including vision (image/video understanding).

Credits

  • Uncensoring by HauhauCS
  • Base model by Qwen
  • NVFP4 quantization and deployment by Li101
HUGGING FACE

上游数据

HF 下载量296
HF 点赞量2

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
Li101
最近更新
2026/03/26
最新创建
2026/03/26
HF 趋势
未知
数据快照
2026/09/16
版本
未知
许可证
apache-2.0