license: other license_name: lil-license-1.0 license_link: LICENSE base_model:
- diffbot/DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000
- jcartu/DeepSeek-V4.1-Flash-1017-abliterated-lossless-CSF pipeline_tag: text-generation tags:
- deepseek-v4.1-flash-1017
- exl3
- abliterated
- vllm
- sm120 extra_gated_heading: Research access extra_gated_prompt: This is an experimental abliterated model intended for research and evaluation. extra_gated_fields: Intended research use: text
DeepSeek V4.1 Flash 1017 — Abliterated EXL3 3-bit
Based on Diffbot's EXL3 checkpoint, with 132 FP8 weight and scale tensors for attn.wo_b and ffn.shared_experts.w2 in layers 4–36 replaced byte-for-byte from jcartu's abliterated checkpoint. All other model tensors retain Diffbot's bytes; no training or additional requantization was performed. The donor derives from DeepSeek-V4.1-Flash-1017-lossless-CSF by Local Inference Lab, Inc., a non-profit organization, licensed under the Local Inference Lab License, Version 1.0.
Follow Diffbot's run instructions, substituting this repository's ID in the download command.
Basic inference, reasoning and tool calls were checked on 2× RTX PRO 6000 Blackwell with TP2 at a configured 512K context limit. CPU-assisted execution and long-context quality were not evaluated.
For research and evaluation only. Refusal behaviour has been modified; outputs may be unsafe or incorrect. Users assume full responsibility for their use of this model and its outputs.
If you find this model useful, please thank Diffbot and jcartu - this release just combines their work.