Error analysis

[peter6888]

after few hours run on intra_attention with no pointer. The rouge score looks like below

{'rouge_w_1.2_recall_ce': 0.02199, 'rouge_su*_precision_ce': 0.00443, 'rouge_su*_precision_cb': 0.00272, 'rouge_4_f_score': 0.0, 'rouge_2_precision': 0.00331, 'rouge_1_recall': 0.03905, 'rouge_2_precision_ce': 0.00447, 'rouge_l_recall_cb': 0.032, 'rouge_1_f_score': 0.03384, 'rouge_s*_precision': 0.00215, 'rouge_su*_recall_cb': 0.00386, 'rouge_3_f_score_cb': 0.00023, 'rouge_4_precision': 0.0, 'rouge_w_1.2_recall_cb': 0.017, 'rouge_s*_f_score_ce': 0.00261, 'rouge_w_1.2_precision': 0.02595, 'rouge_2_f_score_ce': 0.00476, 'rouge_s*_precision_cb': 0.00153, 'rouge_su*_recall_ce': 0.00587, 'rouge_2_recall': 0.00416, 'rouge_2_precision_cb': 0.00227, 'rouge_1_precision_ce': 0.0368, 'rouge_3_precision_cb': 0.0002, 'rouge_1_recall_cb': 0.03401, 'rouge_l_f_score': 0.03173, 'rouge_w_1.2_recall': 0.01941, 'rouge_s*_recall_cb': 0.00192, 'rouge_2_recall_cb': 0.00287, 'rouge_s*_recall': 0.00264, 'rouge_3_f_score_ce': 0.00096, 'rouge_su*_recall': 0.00484, 'rouge_w_1.2_f_score_cb': 0.01863, 'rouge_4_f_score_cb': 0.0, 'rouge_l_recall_ce': 0.0418, 'rouge_4_recall': 0.0, 'rouge_w_1.2_precision_ce': 0.02969, 'rouge_4_recall_ce': 0.0, 'rouge_1_f_score_ce': 0.03845, 'rouge_4_recall_cb': 0.0, 'rouge_3_precision_ce': 0.00087, 'rouge_w_1.2_precision_cb': 0.02251, 'rouge_1_recall_ce': 0.04449, 'rouge_su*_precision': 0.00354, 'rouge_su*_f_score_cb': 0.00279, 'rouge_s*_recall_ce': 0.00342, 'rouge_3_f_score': 0.00057, 'rouge_s*_f_score': 0.00203, 'rouge_w_1.2_f_score': 0.02127, 'rouge_1_precision_cb': 0.02754, 'rouge_2_f_score': 0.00354, 'rouge_2_recall_ce': 0.00569, 'rouge_w_1.2_f_score_ce': 0.02399, 'rouge_3_recall': 0.00066, 'rouge_l_precision_cb': 0.02556, 'rouge_l_f_score_cb': 0.02755, 'rouge_1_f_score_cb': 0.02944, 'rouge_l_precision_ce': 0.03446, 'rouge_l_f_score_ce': 0.03617, 'rouge_su*_f_score_ce': 0.00429, 'rouge_l_precision': 0.02989, 'rouge_3_recall_cb': 0.00027, 'rouge_su*_f_score': 0.00352, 'rouge_4_precision_ce': 0.0, 'rouge_4_f_score_ce': 0.0, 'rouge_2_f_score_cb': 0.00245, 'rouge_1_precision': 0.03199, 'rouge_s*_f_score_cb': 0.00148, 'rouge_3_precision': 0.00051, 'rouge_4_precision_cb': 0.0, 'rouge_l_recall': 0.03677, 'rouge_s*_precision_ce': 0.00284, 'rouge_3_recall_ce': 0.00116}