search

AtmaHou / Task-Oriented-Dialogue-Research-Progress-Survey

A datasets and methods survey about task-oriented dialogue, including recent datasets and SOTA leaderboards.
1.24k stars 216 forks source link

Update Leader Boards of NLU #4

Closed sz128 closed 5 years ago

sz128 commented 5 years ago

Update the leader boards of NLU. Hope it helps :)

AtmaHou commented 5 years ago

Hi， thanks again for your contribution! I am confused about why do you remove some leader board NLU results, such as Joint Seq. (Hakkani-Tur et al., 2016).

Is there any reason or just a simple omission?

sz128 commented 5 years ago

@AtmaHou Hi! I think it is better to print results from the original papers on the leader board. Therefore, I updated results of Atten-based (Liu and Lane, 2016). Joint Seq (Hakkani-Tur et al., 2016) is removed because I didn't find results about ATIS and SNIPS datasets in the original paper. How do you think of that?

AtmaHou commented 5 years ago

I thought about it: indeed, the credibility of the original results is higher. It is better to accept this improvement. Thanks again for your effort!