As far as I understand, the intent is created with scenario_action, but in these two cases the scenario was ignored when created the intent. Is this a bug or it was made on purpose?
I can see there are quite a lot more examples of play_podcasts and iot_wemo_off, which would the intent for the previous cases.
I was looking at the gold data in SLURP jsonl format placed https://github.com/pswietojanski/slurp/blob/master/dataset/slurp/train.jsonl and I noticed there are a few intents with very low examples, as for example
podcasts
orwemo_off
As far as I understand, the intent is created with
scenario
_action
, but in these two cases the scenario was ignored when created the intent. Is this a bug or it was made on purpose?I can see there are quite a lot more examples of
play_podcasts
andiot_wemo_off
, which would the intent for the previous cases.This happens also in the https://github.com/pswietojanski/slurp/blob/master/dataset/slurp/test.jsonl which will be affecting the performance results I think, is this right?
Thanks for you help.