library_name: transformers base_model: Qwen/Qwen3.5-4B license: apache-2.0 language: [en] tags:

• agent
• abliteration
• orthogonalization
• weight-ortho
• soyuz
• qwen3.5 datasets:
• AlexWortega/Soyuz-sft

Qwen3.5-4B Soyuz — Abliterated (v3)

Weight-orthogonalised version of AlexWortega/qwen35-4b-soyuz-merged. Removes the residual-stream "fail-mode" component identified from the model's own pass-vs-fail trajectory contrasts.

Usage with sglang

python -m sglang.launch_server \
    --model-path AlexWortega/qwen35-4b-soyuz-abliterated-v3-multi \
    --dtype bfloat16 --trust-remote-code \
    --tool-call-parser hermes \
    --chat-template hermes_qwen.jinja

(hermes parser is needed for the <tool_call>{...}</tool_call> → OpenAI tool_calls conversion — without it agent benches see zero tool calls.)

Abliteration recipe

1. Build pass-vs-fail contrast: 60 PASS trajectories (reward=1.0) + 60 cleaned FAIL trajectories from soyuz's own evals (claw-eval, tbench-2, MMLU-Pi-agent). Fail trajectories filtered by Gemini-3-flash to keep only CLEAN_FAIL labels (235 of 246 negatives).
2. Capture last-token residual activations per layer over the rendered contrast (text-only Qwen3_5ForCausalLM).
3. Compute per-layer direction = mean(refuse) - mean(comply), normalise; pick best layer via AUC.
4. Orthogonalise model weights (embed rows + every layer's o_proj.weight and down_proj.weight columns) against the direction, optionally blended with strength α: W ← W − α · (W − W_orth).
5. Wrap text-only weights into the multimodal Qwen3_5ForConditionalGeneration arch so sglang can serve them (vision tower preserved from base; only language_model.* weights are abliterated).

Repos

v2 = highest HA20 (2× baseline). v3 picks up disjoint HA20 tasks (HA-01/02 memory-specific) that v2 misses.

W&B + raw eval logs: https://wandb.ai/alexwortega/vae-llm-agents (training base).