玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
reaperdoesntknow /

DiStil-Qwen3-1.7B-uncensored

HF 源站

reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored is an uncensored open-source model hosted on Hugging Face.

safetensors1.7Btensorboardqwen3convergentinteledgedistillationknowledge-distillation
README.md说明 / 使用方法

base_model:

  • reaperdoesntknow/TopologicalQwen tags:
  • convergentintel
  • edge
  • distillation
  • knowledge-distillation

DiStil-Qwen3-1.7B-uncensored

Uncensored Distillation of Qwen3-1.7B — Alignment-Free Capability Transfer

Convergent Intelligence LLC: Research Division


What This Is

DiStil-Qwen3-1.7B-uncensored is a 1.7B parameter model produced by distilling Qwen3 with uncensored SFT data, removing alignment-imposed refusal behaviors while preserving the base model's reasoning and generation capabilities. The goal is a model that responds to the prompt as given rather than filtering through safety heuristics that often misfire on legitimate technical, analytical, and research queries.

This is the base model in a distillation chain:

  • DiStil-Qwen3-1.7B-uncensored ← you are here
  • → Disctil-Qwen3-1.7B (DISC-informed refinement)

Architecture

ParameterValue
ArchitectureQwen3ForCausalLM
Parameters~2.03B (1.7B effective)
Hidden Size2048
Layers28
Attention Heads16 (Q) / 8 (KV) — GQA
Intermediate6144
Context Length40,960 tokens
Vocabulary151,936

Training

Supervised fine-tuning using TRL on uncensored instruction data. The training preserves the base Qwen3 architecture and tokenizer while shifting the model's response distribution away from refusal patterns. No architectural modifications — this is a pure SFT intervention on the response surface.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored",
    torch_dtype="auto",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored")

messages = [{"role": "user", "content": "Explain the tradeoffs between alignment training and capability preservation in small language models."}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
output = model.generate(**inputs, max_new_tokens=512, temperature=0.7, top_p=0.9)
print(tokenizer.decode(output[0], skip_special_tokens=True))

Mathematical Foundations: Discrepancy Calculus (DISC)

This model is part of a distillation chain built on Discrepancy Calculus — a measure-theoretic framework where the teacher's output distribution is decomposed via the Mesh Fundamental Identity into smooth (AC), jump, and Cantor components. The discrepancy operator $Df(x) = \lim_{\varepsilon \downarrow 0} \frac{1}{\varepsilon} \int_x^{x+\varepsilon} \frac{|f(t) - f(x)|}{|t - x|} dt$ quantifies local structural mismatch that standard KL divergence averages away.

Full theory: "On the Formal Analysis of Discrepancy Calculus" (CIx, 2026; Convergent Intelligence LLC: Research Division). Full methodology: Structure Over Scale (DOI: 10.57967/hf/8165).

Related Models

ModelDescriptionDownloads
Disctil-Qwen3-1.7BDISC-informed refinement of this model286
DistilQwen3-1.7B-uncensoredParallel distillation variant351
DistilQwen3-1.7B-uncensored-GGUFQuantized for edge deployment239
TopologicalQwenTopology-aware distillation (TKD)622

DistilQwen Collection — Full proof-weighted distillation series

Full methodology: Structure Over Scale (DOI: 10.57967/hf/8165)

Citation

@misc{cix2026distiluncensored,
  title={DiStil-Qwen3-1.7B-uncensored: Alignment-Free Capability Transfer},
  author={Convergent Intelligence},
  year={2026},
  publisher={HuggingFace},
  url={https://huggingface.co/reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored},
  note={Convergent Intelligence LLC: Research Division}
}


From the Convergent Intelligence Portfolio

DistilQwen Collection — Our only BF16 series. Proof-weighted distillation from Qwen3-30B-A3B → 1.7B and 0.6B on H100. Three teacher variants (Instruct, Thinking, Coder), nine models, 2,788 combined downloads. The rest of the portfolio proves structure beats scale on CPU. This collection shows what happens when you give the methodology real hardware.

Top model: Qwen3-1.7B-Coder-Distilled-SFT — 508 downloads

Full methodology: Structure Over Scale (DOI: 10.57967/hf/8165)

Convergent Intelligence LLC: Research Division

Convergent Intelligence LLC: Research Division "Where classical analysis fails to see, we begin."


Part of the reaperdoesntknow research portfolio — 49 models, 22,598 total downloads | Last refreshed: 2026-03-30 12:05 UTC


Last updated: 2026-03-31 by Convergent Intelligence LLC: Research Division

HUGGING FACE

上游数据

HF 下载量320
HF 点赞量1

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
reaperdoesntknow
最近更新
2026/09/16
最新创建
2026/03/28
HF 趋势
828
数据快照
2026/09/16
版本
未知
许可证
unknown