alontalmor / WebAsKB

74 stars 10 forks source link

evaluation matrix #10

Open cdhx opened 3 years ago

cdhx commented 3 years ago

I wonder what is this matrix means

appreciate for any help, if you can give hint to any one of this matrics except exact match

prev max adjusted accuracy 0.7492
evaluate  0 / 2000
loss: 0.0046, accuracy: 1.0000
evaluate  500 / 2000
loss: 0.5999, accuracy: 0.7273
evaluate  1000 / 2000
loss: 0.6134, accuracy: 0.7334
evaluate  1500 / 2000
loss: 0.6312, accuracy: 0.7342
evalset loss 0.6322
adjusted accuracy 0.7402
avg_exact_token_match 0.6985
exact_match 0.4915
avg_one_tol_token_match 0.7562
exact_match_one_tol 0.6215
comp_accuracy 0.8190
p1_accuracy 0.5955
p2_accuracy 0.6810
p1_1_right_accuracy 0.0415
p1_1_left_accuracy 0.0500