ベースラインモデルの実装

HayatoKTYM commented 3 years ago

フォルダ名

**./baseline**

概要

発話末 (非発話区間の開始時) のみ予測
出力はどれくらい待ってから発話するか (0 ~ 59) ，または，発話しない (60) の回帰モデル

やること

utils/ 内のプログラムを整理， TGNN都響通過できるものは共通化

HayatoKTYM commented 3 years ago

メモ

シングルタスクのシードごとの重み

PATH = '/mnt/aoni04/katayama/share/TGNN/baseline/logs/ctc/seed0/202012241424/epoch_30_loss_1.061.pth'
PATH = '/mnt/aoni04/katayama/share/TGNN/baseline/logs/ctc/seed1/202012241322/epoch_31_loss_1.039.pth'
PATH = '/mnt/aoni04/katayama/share/TGNN/baseline/logs/ctc/seed2/202012241323/epoch_50_loss_1.038.pth'

各シードの重みをもとに得られた結果(pre,rec,f1)


/mnt/aoni04/katayama/share/TGNN/baseline/np/seed0/
/mnt/aoni04/katayama/share/TGNN/baseline/np/seed1/
/mnt/aoni04/katayama/share/TGNN/baseline/np/seed2/

HayatoKTYM commented 3 years ago

各シードから得た結果を平均したもの．

/mnt/aoni04/katayama/share/TGNN/baseline/np/average

HayatoKTYM commented 3 years ago

メモ学習済み重み (シングルタスク)

overlap データも使用したバージョン weight1 (loss がもっとも小さい時の重みを保存)

/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight1/seed0/202012250206/epoch_45_loss_0.836.pth
/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight1/seed1/202012250207/epoch_46_loss_0.833.pth
/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight1/seed2/202012250207/epoch_44_loss_0.855.pth

weight2

/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight2/seed0/202012251101/epoch_27_loss_1.423.pth
/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight2/seed1/202012251057/epoch_22_loss_1.531.pth
/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight2/seed2/202012251057/epoch_41_loss_1.499.pth

weight3

/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight3/seed0/202012250351/epoch_35_loss_2.038.pth
/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight3/seed1/202012250353/epoch_19_loss_2.134.pth
/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight3/seed2/202012250353/epoch_57_loss_2.130.pth

許容誤差-性能曲線(npy)

weight1 /mnt/aoni04/katayama/share/work/1225/TGNN/baseline/np/weight1/average/**npy weight2 /mnt/aoni04/katayama/share/work/1225/TGNN/baseline/np/weight2/average/**npy weight3 /mnt/aoni04/katayama/share/work/1225/TGNN/baseline/np/weight3/average/**npy

weight1 の可視化例

HayatoKTYM commented 3 years ago

メモ学習済み重み (マルチタスク)

'/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight1/mt/seed0/202012261642/epoch_17_loss_0.808.pth'
'/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight1/mt/seed1/202012261642/epoch_16_loss_0.829.pth'
'/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/logs/ctc/1225/weight1/mt/seed2/202012261642/epoch_20_loss_0.821.pth'

許容誤差-性能曲線(npy)

'/mnt/aoni04/katayama/share/work/1225/TGNN/baseline/np/mt/weight1/average/'

HayatoKTYM commented 3 years ago

サブタスク(応答義務推定) 結果

average Acc: 0.87

seed0

応答義務推定 acc: 0.8604206500956023
[[811  58]
[ 88  89]]

seed1


応答義務推定 acc: 0.872848948374761
[[796  73]
[ 60 117]]


- seed2

応答義務推定 acc: 0.8804971319311663 [[820 49] [ 76 101]]

JinSakuma / TGNN