HuggingFace镜像/MiniLM-evidence-types
模型介绍文件和版本分析
下载使用量0

MiniLM-evidence-types

该模型是基于 MiniLM-L12-H384-uncased 在证据类型数据集上微调得到的版本。它在评估集上取得了以下结果:

  • 损失:1.8672
  • 宏 F1 值:0.3726
  • 加权 F1 值:0.7030
  • 准确率:0.7161
  • 平衡准确率:0.3616

训练与评估数据

该数据集以及用于微调此模型的代码可在 GitHub 仓库 BA-Thesis-Information-Science-Persuasion-Strategies 中找到。

训练超参数

训练过程中使用了以下超参数:

  • 学习率:2e-05
  • 训练批次大小:16
  • 评估批次大小:16
  • 随机种子:42
  • 优化器:Adam,其参数 betas=(0.9, 0.999),epsilon=1e-08
  • 学习率调度器类型:线性
  • 训练轮数:20
  • 混合精度训练:Native AMP

训练结果

训练损失轮次步数验证损失宏 F1 值加权 F1 值准确率平衡准确率
1.41061.02501.26980.19660.60840.67350.2195
1.14372.05001.09850.34840.69140.71160.3536
0.97143.07501.09010.26060.64130.64460.2932
0.83824.010001.01970.27640.70240.72370.2783
0.71925.012501.08950.28470.68240.69630.2915
0.62496.015001.12960.34870.68880.69480.3377
0.53367.017501.15150.35910.69820.70240.3496
0.46948.020001.19620.36260.71850.73140.3415
0.40589.022501.33130.31210.69200.70850.3033
0.374610.025001.39930.36280.69760.70470.3495
0.326711.027501.50780.35600.69580.70550.3464
0.293912.030001.58750.36850.69680.70620.3514
0.267713.032501.64700.36060.69760.70700.3490
0.242514.035001.71640.37140.70690.72070.3551
0.230115.037501.81510.35970.69750.71230.3466
0.226816.040001.78380.39400.70340.71230.3869
0.20117.042501.83280.37250.69640.70620.3704
0.192318.045001.87880.37080.70190.71540.3591
0.179519.047501.85740.37520.70310.71610.3619
0.171320.050001.86720.37260.70300.71610.3616

框架版本

  • Transformers 4.19.2
  • Pytorch 1.11.0+cu113
  • Datasets 2.2.2
  • Tokenizers 0.12.1