玩模型开放模型 · 清晰来源 · 自主选择
返回模型目录
girishgupta /

deep-ignorance-unfiltered_unlearned_wt_dist_reg

HF 源站

girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist_reg is an uncensored open-source model hosted on Hugging Face.

safetensorsgpt_neoxunlearning
README.md说明 / 使用方法

tags:

  • unlearning base_model: EleutherAI/deep-ignorance-unfiltered

deep-ignorance-unfiltered_unlearned_wt_dist_reg

This model was created by fine-tuning EleutherAI/deep-ignorance-unfiltered using the Weight Distortion (Regularized) unlearning algorithm. The method is based on Siddiqui et al. 2025. The goal of unlearning is to remove specific knowledge from a pretrained language model while preserving its general capabilities.

Hyperparameters

ParameterValue
Base modelEleutherAI/deep-ignorance-unfiltered
Unlearning methodWeight Distortion (Regularized)
Learning rate3e-05
Epochs3
Batch size32
Max sequence length512
Optimizeradamw
Gradient clipping1.0
Gradient accumulation steps1
Seed42
W&B / run namewt_dist_reg__ep3_lr3e-05_bs32_wr1.0_mle512_mli10000
Regularizer lambda1.0

Evaluation Results

BenchmarkValue
mmlu / acc0.2597
mmlu / acc_stderr0.0037
mmlu_abstract_algebra / acc0.1900
mmlu_abstract_algebra / acc_stderr0.0394
mmlu_anatomy / acc0.2074
mmlu_anatomy / acc_stderr0.0350
mmlu_astronomy / acc0.3289
mmlu_astronomy / acc_stderr0.0382
mmlu_business_ethics / acc0.2200
mmlu_business_ethics / acc_stderr0.0416
mmlu_clinical_knowledge / acc0.2906
mmlu_clinical_knowledge / acc_stderr0.0279
mmlu_college_biology / acc0.2500
mmlu_college_biology / acc_stderr0.0362
mmlu_college_chemistry / acc0.3700
mmlu_college_chemistry / acc_stderr0.0485
mmlu_college_computer_science / acc0.3000
mmlu_college_computer_science / acc_stderr0.0461
mmlu_college_mathematics / acc0.2200
mmlu_college_mathematics / acc_stderr0.0416
mmlu_college_medicine / acc0.3295
mmlu_college_medicine / acc_stderr0.0358
mmlu_college_physics / acc0.2745
mmlu_college_physics / acc_stderr0.0444
mmlu_computer_security / acc0.2200
mmlu_computer_security / acc_stderr0.0416
mmlu_conceptual_physics / acc0.2000
mmlu_conceptual_physics / acc_stderr0.0261
mmlu_econometrics / acc0.2281
mmlu_econometrics / acc_stderr0.0395
mmlu_electrical_engineering / acc0.2897
mmlu_electrical_engineering / acc_stderr0.0378
mmlu_elementary_mathematics / acc0.2407
mmlu_elementary_mathematics / acc_stderr0.0220
mmlu_formal_logic / acc0.3889
mmlu_formal_logic / acc_stderr0.0436
mmlu_global_facts / acc0.2000
mmlu_global_facts / acc_stderr0.0402
mmlu_high_school_biology / acc0.2806
mmlu_high_school_biology / acc_stderr0.0256
mmlu_high_school_chemistry / acc0.2906
mmlu_high_school_chemistry / acc_stderr0.0319
mmlu_high_school_computer_science / acc0.2500
mmlu_high_school_computer_science / acc_stderr0.0435
mmlu_high_school_european_history / acc0.2485
mmlu_high_school_european_history / acc_stderr0.0337
mmlu_high_school_geography / acc0.2374
mmlu_high_school_geography / acc_stderr0.0303
mmlu_high_school_government_and_politics / acc0.3368
mmlu_high_school_government_and_politics / acc_stderr0.0341
mmlu_high_school_macroeconomics / acc0.2974
mmlu_high_school_macroeconomics / acc_stderr0.0232
mmlu_high_school_mathematics / acc0.2370
mmlu_high_school_mathematics / acc_stderr0.0259
mmlu_high_school_microeconomics / acc0.2437
mmlu_high_school_microeconomics / acc_stderr0.0279
mmlu_high_school_physics / acc0.2583
mmlu_high_school_physics / acc_stderr0.0357
mmlu_high_school_psychology / acc0.3431
mmlu_high_school_psychology / acc_stderr0.0204
mmlu_high_school_statistics / acc0.3380
mmlu_high_school_statistics / acc_stderr0.0323
mmlu_high_school_us_history / acc0.2990
mmlu_high_school_us_history / acc_stderr0.0321
mmlu_high_school_world_history / acc0.2068
mmlu_high_school_world_history / acc_stderr0.0264
mmlu_human_aging / acc0.1031
mmlu_human_aging / acc_stderr0.0204
mmlu_human_sexuality / acc0.2824
mmlu_human_sexuality / acc_stderr0.0395
mmlu_humanities / acc0.2508
mmlu_humanities / acc_stderr0.0063
mmlu_international_law / acc0.1488
mmlu_international_law / acc_stderr0.0325
mmlu_jurisprudence / acc0.2593
mmlu_jurisprudence / acc_stderr0.0424
mmlu_logical_fallacies / acc0.2209
mmlu_logical_fallacies / acc_stderr0.0326
mmlu_machine_learning / acc0.2232
mmlu_machine_learning / acc_stderr0.0395
mmlu_management / acc0.3495
mmlu_management / acc_stderr0.0472
mmlu_marketing / acc0.2521
mmlu_marketing / acc_stderr0.0284
mmlu_medical_genetics / acc0.2700
mmlu_medical_genetics / acc_stderr0.0446
mmlu_miscellaneous / acc0.2299
mmlu_miscellaneous / acc_stderr0.0150
mmlu_moral_disputes / acc0.2312
mmlu_moral_disputes / acc_stderr0.0227
mmlu_moral_scenarios / acc0.2737
mmlu_moral_scenarios / acc_stderr0.0149
mmlu_nutrition / acc0.2810
mmlu_nutrition / acc_stderr0.0257
mmlu_other / acc0.2559
mmlu_other / acc_stderr0.0077
mmlu_philosophy / acc0.2444
mmlu_philosophy / acc_stderr0.0244
mmlu_prehistory / acc0.2037
mmlu_prehistory / acc_stderr0.0224
mmlu_professional_accounting / acc0.2199
mmlu_professional_accounting / acc_stderr0.0247
mmlu_professional_law / acc0.2555
mmlu_professional_law / acc_stderr0.0111
mmlu_professional_medicine / acc0.4007
mmlu_professional_medicine / acc_stderr0.0298
mmlu_professional_psychology / acc0.2222
mmlu_professional_psychology / acc_stderr0.0168
mmlu_public_relations / acc0.2364
mmlu_public_relations / acc_stderr0.0407
mmlu_security_studies / acc0.3102
mmlu_security_studies / acc_stderr0.0296
mmlu_social_sciences / acc0.2756
mmlu_social_sciences / acc_stderr0.0080
mmlu_sociology / acc0.2338
mmlu_sociology / acc_stderr0.0299
mmlu_stem / acc0.2613
mmlu_stem / acc_stderr0.0078
mmlu_us_foreign_policy / acc0.2700
mmlu_us_foreign_policy / acc_stderr0.0446
mmlu_virology / acc0.2229
mmlu_virology / acc_stderr0.0324
mmlu_world_religions / acc0.2281
mmlu_world_religions / acc_stderr0.0322
wikitext / bits_per_byte1.7813
wikitext / bits_per_byte_stderrN/A
wikitext / byte_perplexity3.4373
wikitext / byte_perplexity_stderrN/A
wikitext / word_perplexity736.9357
wikitext / word_perplexity_stderrN/A
wmdp_bio_categorized_mcqa / acc0.2270
wmdp_bio_categorized_mcqa / acc_stderr0.0118
wmdp_bio_cloze_verified / acc_norm0.2184
wmdp_bio_cloze_verified / acc_norm_stderr0.0126
wmdp_bio_robust / acc0.2350
wmdp_bio_robust / acc_stderr0.0144
wmdp_bio_robust_bioweapons_and_bioterrorism / acc0.2368
wmdp_bio_robust_bioweapons_and_bioterrorism / acc_stderr0.0309
wmdp_bio_robust_dual_use_virology / acc0.2500
wmdp_bio_robust_dual_use_virology / acc_stderr0.0833
wmdp_bio_robust_enhanced_potential_pandemic_pathogens / acc0.2353
wmdp_bio_robust_enhanced_potential_pandemic_pathogens / acc_stderr0.0422
wmdp_bio_robust_expanding_access_to_threat_vectors / acc0.1905
wmdp_bio_robust_expanding_access_to_threat_vectors / acc_stderr0.0878
wmdp_bio_robust_reverse_genetics_and_easy_editing / acc0.1882
wmdp_bio_robust_reverse_genetics_and_easy_editing / acc_stderr0.0287
wmdp_bio_robust_rewritten / acc0.2351
wmdp_bio_robust_rewritten / acc_stderr0.0086
wmdp_bio_robust_rewritten_gibberish / acc0.2256
wmdp_bio_robust_rewritten_gibberish / acc_stderr0.0147
wmdp_bio_robust_rewritten_nonsensical_biology / acc0.2232
wmdp_bio_robust_rewritten_nonsensical_biology / acc_stderr0.0146
wmdp_bio_robust_rewritten_real_words_sciency / acc0.2565
wmdp_bio_robust_rewritten_real_words_sciency / acc_stderr0.0153
wmdp_bio_robust_viral_vector_research / acc0.2610
wmdp_bio_robust_viral_vector_research / acc_stderr0.0238
wmdp_bio_shortcut / acc0.2099
wmdp_bio_shortcut / acc_stderr0.0204
wmdp_bio_shortcut_bioweapons_and_bioterrorism / acc0.2128
wmdp_bio_shortcut_bioweapons_and_bioterrorism / acc_stderr0.0603
wmdp_bio_shortcut_dual_use_virology / acc0.2105
wmdp_bio_shortcut_dual_use_virology / acc_stderr0.0961
wmdp_bio_shortcut_enhanced_potential_pandemic_pathogens / acc0.1887
wmdp_bio_shortcut_enhanced_potential_pandemic_pathogens / acc_stderr0.0543
wmdp_bio_shortcut_expanding_access_to_threat_vectors / acc0.1111
wmdp_bio_shortcut_expanding_access_to_threat_vectors / acc_stderr0.1111
wmdp_bio_shortcut_reverse_genetics_and_easy_editing / acc0.2471
wmdp_bio_shortcut_reverse_genetics_and_easy_editing / acc_stderr0.0471
wmdp_bio_shortcut_viral_vector_research / acc0.2031
wmdp_bio_shortcut_viral_vector_research / acc_stderr0.0291
HUGGING FACE

上游数据

HF 下载量11
HF 点赞量0

HF 下载量为源站最近 30 天统计，与本站点击分开。

SITE STATS

本站统计

下载点击—
请求数—
匿名去重—最近 7 天—

本站下载量记录按钮点击，不代表下载完成；短时连点会去重。

来源与版本

作者
girishgupta
最近更新
2026/03/21
最新创建
2026/03/21
HF 趋势
未知
数据快照
2026/09/17
版本
未知
许可证
unknown