玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
AITRADER /

Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX

HF 源站

AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX is an uncensored open-source model hosted on Hugging Face.

Text GenerationMLX LMsafetensorsEnglishLicense: apache-2.04Bmlxqwen3_5abliterateduncensoredqwen3.5reasoningclaude-distilledconversational
README.md说明 / 使用方法

base_model: Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled language: en pipeline_tag: text-generation library_name: mlx tags:

  • mlx
  • abliterated
  • uncensored
  • qwen3.5
  • reasoning
  • claude-distilled license: apache-2.0

Jackrong Qwen3.5-4B Claude Reasoning - Abliterated (bf16 MLX)

This is an abliterated (uncensored) version of Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled, converted to MLX format for Apple Silicon.

What is this model?

The base model is Qwen3.5-4B fine-tuned on Claude 4.6 Opus reasoning data using Unsloth/LoRA, giving it strong chain-of-thought reasoning capabilities. This abliterated version removes safety refusal behaviors while preserving the model's reasoning abilities.

Abliteration Details

  • Method: lukey03 (1 direction, norm-preserving, 3 refinement passes, output-only projection)
  • Post-processing: LoRA compliance fine-tuning (rank=64, 80 iterations, 32 training examples)
  • Format: bf16 MLX (Apple Silicon native)
  • Refusal rate: ~12% on 100 adversarial prompts (85% compliance)
  • Tool: OBLITERATUS

Architecture

Qwen3.5 hybrid attention architecture:

  • 32 layers (8 full attention + 24 linear attention with GatedDeltaNet)
  • 2560 hidden size, 16 attention heads, 4 KV heads
  • ~4B parameters
  • 262K max context length

Usage

pip install mlx-lm

# Generate text
mlx_lm.generate --model AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX --prompt "Explain quantum computing"
from mlx_lm import load, generate

model, tokenizer = load("AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX")
response = generate(model, tokenizer, prompt="Your prompt here", max_tokens=512)

Quantized Version

A MXFP8 quantized version (~4.1 GB) is available at: AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-mxfp8-MLX

Disclaimer

This model is provided for research purposes. Users are responsible for ensuring their use complies with applicable laws and regulations.

HUGGING FACE

上游数据

HF 下载量36
HF 点赞量0

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
AITRADER
最近更新
2026/03/13
最新创建
2026/03/08
HF 趋势
未知
数据快照
2026/10/07
版本
未知
许可证
apache-2.0