玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
nico248000000000 /

Qwen3.8-27B-Uncensored-cyber-LoRA

HF 源站

nico248000000000/Qwen3.8-27B-Uncensored-cyber-LoRA is an uncensored open-source model hosted on Hugging Face.

Image-Text-to-TextUnsloth DesktopsafetensorsEnglishLicense: other27Bpeftloraqloracybervisionvideoconversationalfrmodel-index
README.md说明 / 使用方法

base_model: orcarouter/Qwen3.8-27B-Uncensored library_name: peft pipeline_tag: image-text-to-text license: other language:

  • en
  • fr tags:
  • unsloth
  • lora
  • qlora
  • cyber
  • image-text-to-text
  • vision
  • video
  • peft

model-index:

  • name: Qwen3.8-27B-Uncensored-cyber — LoRA results:
    • task: type: text-generation name: Causal language modeling dataset: name: cyber SFT holdout type: dataset_cyber.quality.jsonl metrics:
      • type: loss value: 0.877844 name: eval_loss

[!WARNING] Testing only — not for production. Models published from these notebooks are maintained solely for testing and evaluation purposes and are not intended for production use. The enrichment data used with them was created by the author and subsequently enhanced with the assistance of AI models.

Qwen3.8-27B-Uncensored-cyber — LoRA

Instruction-tuned cybersecurity assistant (offensive, defensive, GRC, architecture, SOC/DFIR, RSSI).

Base modelorcarouter/Qwen3.8-27B-Uncensored
Domaincyber
MethodLoRA / QLoRA (Unsloth) · rank 8 · α 16
Quantization at trainbf16 LoRA
Context4096 tokens
Datasetdataset_cyber.quality.jsonl · train 56538 / eval 2976
GPUNVIDIA RTX PRO 6000 Blackwell Server Edition (95.0 GiB)
Wall time231.5 min
Modalities keptvision, video

This checkpoint continues a strong general model and specialises it on a curated SFT corpus of cybersecurity procedures: pentest / red team, SOC and DFIR, cloud and identity, GRC (ISO, NIST, NIS2, DORA), and RSSI / project-management questions. Answers are meant to be concrete (controls, detections, hardening), not generic essays.

Final model evaluation

SFT release verdict: GO.

The same untouched holdout is evaluated with the adapter disabled before training and with the best restored adapter after training. Periodic validation and the train/validation gap are also checked for regression or memorization.

Reference checkpoint: orcarouter/Qwen3.8-27B-Uncensored.

MetricReference (base / first log)This fine-tuneΔ
Holdout loss (true pre-SFT -> best LoRA)3.09540.8778-71.6%
Best periodic holdout loss—0.8778—
Train loss (first → last logged)3.15090.9779-69.0%
Train loss (best)—0.7867—
Eval loss (holdout, first → last)1.06820.8778-17.8%

The reference holdout loss is measured before optimizer step 1, then the same untouched split is measured again after Trainer restores its best checkpoint.

Release checks

CheckResultSeverityDetail
True pre-training holdout baseline existsPASShardbaseline_loss=3.0954 (measured before optimizer step 1)
Post-SFT holdout evaluation existsPASShardpost_sft_loss=0.8778 (best checkpoint reloaded)
No holdout regression versus basePASShard3.0954 -> 0.8778 (+71.64% improvement; allowed regression 2.0%)
Repeated validation during trainingPASShard10 evaluations (need >= 2)
No late validation reboundPASShardbest=0.8778, restored=0.8778, rebound=+0.00% (max 5.0%)
Train/validation gap is not a memorization signaturePASSsofttrain/eval=1.142 (need >= 0.25)
Best checkpoint restoration enabledPASShardbest_step=4712, final_step=4712
General text skills preserved (adapter disabled vs enabled)PASShardbase=1.0, SFT=1.0, drop=0.000 (max 0.10)

Multimodal preservation

Verdict: GO. Image/video processors, frozen media towers, trainable parameters and optional functional probes are checked before export.

Training data

  • File: dataset_cyber.quality.jsonl
  • Split: 0.05 holdout, seed 42
  • Format: chat-templated SFT (messages / instruction+output / ### Instruction + ### Response)

Training procedure

HyperparameterValue
Epochs1
Learning rate5e-05
Warmup ratio0.05
Device batch12
Grad accum1
Effective batch12
Optimadamw_8bit
PackingTrue
LoRA targets['q_proj', 'k_proj', 'v_proj', 'o_proj', 'out_proj', 'gate_proj', 'up_proj', 'down_proj']

Intended use

Authorized defensive work, tabletop exercises, control design, detection engineering, audit readiness, and explaining attack techniques without weaponized payloads.

Out of scope: Do not use it to attack systems you do not own, to generate exploit payloads, or as a substitute for a licensed auditor or incident commander.

Multimodal

Kept modalities: vision, video. Media layers were frozen during text SFT (vision=False, audio=False). Load the merged Transformers folder (or GGUF + mmproj) to keep vision, video. Preservation audit: GO.

Sample (post-train smoke test)

Prompt: How do you design a reliable Zero Trust infrastructure? Answer with a concrete control list.

system
Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.
user
How do you design a reliable Zero Trust infrastructure? Answer with a concrete control list.
assistant
<think>
I need to answer the user's question: "How do you design a reliable Zero Trust infrastructure? Answer with a concrete control list." The request is in English. I must produce the final answer in English. Need include concrete control list. Think about Zero Trust architecture: identity, device posture, least privilege, continuous verification, microsegmentation, encrypted traffic, logging, threat detection, automation, resilience. The user likely wants a control list, maybe mapped to NIST/ISO. Need be practical: prerequisites, architecture, controls: identity federation, MFA, device compliance, PEP/PDP, network segmentation, application access, data classification, encryption, key management, logging, SIEM, XDR, endpoint EDR, vulnerability management, software supply chain, incident response, resilience, admin isolation, secrets management, API security, cloud guardrails, continuous assessment. Also mention reliability not just policy: high availability, redundancy, failover, health checks, observability, change management. Could

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

base = 'orcarouter/Qwen3.8-27B-Uncensored'
adapter = "nico248000000000/Qwen3.8-27B-Uncensored-cyber-LoRA"
tok = AutoTokenizer.from_pretrained(adapter, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    base, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter)

Limitations

  • Domain shift: quality drops outside the SFT topics.
  • Eval above is holdout loss (and optional targeted checks). It is not a public leaderboard.
  • The base model license and acceptable-use policy still apply.

License

other — inherit and respect the license of orcarouter/Qwen3.8-27B-Uncensored.

HUGGING FACE

上游数据

HF 下载量79
HF 点赞量1

HF 下载量为源站最近 30 天统计,与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击,不代表下载完成;短时连点会去重。

来源与版本

作者
nico248000000000
最近更新
2026/08/31
最新创建
2026/08/31
HF 趋势
未知
数据快照
2026/09/16
版本
未知
许可证
other