language:
- en
- zh license: apache-2.0 base_model: DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored tags:
- solstice-ai
- davidau
- qwen
- qwen3.8
- qwen3.8-27b
- cold-fusion
- gain
- project-heretic
- heretic
- uncensored
- mxfp4
- ocp
- microscaling
- vllm
- sglang
- compressed-tensors
- 4-bit
- vision
- multimodal
- mmproj pipeline_tag: image-text-to-text
Overview
OCP Microscaling FP4 (MXFP4) format via compressed-tensors with dynamic group scaling, optimized for high throughput inference across modern accelerators.
Serving with vLLM
vllm serve Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MXFP4 \
--tensor-parallel-size 1 \
--max-model-len 262144