search

henryhungle / NADST

Code for the paper Non-Autoregressive Dialog State Tracking (ICLR20)
MIT License
44 stars 5 forks source link

How to decide the domains contained in each dialogue? #5

Closed SparkJiao closed 4 years ago

SparkJiao commented 4 years ago

In other words, how could I get the results showed in Table 7? Currently, I use the domains with non-empty goals in each dialogue, which is annotated as "goal" in data.json. But the results are highly than yours.

Thanks for your help!

henryhungle commented 4 years ago

I used the labels of dialogue states rather than the dialogue goals as I found some sampled dialogue goals contain noisy annotations. If a dialogue contains a non-empty state value from a domain, then that domain is active.