budzianowski / multiwoz

Source code for end-to-end dialogue model from the MultiWOZ paper (Budzianowski et al. 2018, EMNLP)
MIT License
861 stars 200 forks source link

fail_book content is missing in some examples #19

Closed rizar closed 4 years ago

rizar commented 4 years ago

In the example PMUL1848.json the fail_book field for the hotel domain is missing. The prompt message, on the other hand, does include instructions on what to do if booking fails:

If the booking fails how about <span class='emphasis'>friday</span>

Am I right that this is an inconsistency in the data, or am I missing something?

Here is the complete JSON goal:


 'police': {},
 'hospital': {},
 'hotel': {'info': {'area': 'east',
   'internet': 'yes',
   'type': 'guesthouse',
   'parking': 'yes'},
  'fail_info': {},
  'book': {'people': '5', 'day': 'thursday', 'invalid': True, 'stay': '5'}},
 'topic': {'taxi': False,
  'police': False,
  'restaurant': False,
  'hospital': False,
  'hotel': False,
  'general': False,
  'attraction': False,
  'train': False,
  'booking': False},
 'attraction': {},
 'train': {'info': {'destination': 'cambridge',
   'day': 'friday',
   'arriveBy': '14:00',
   'departure': 'stansted airport'},
  'fail_info': {},
  'book': {'invalid': True, 'people': '5'},
  'fail_book': {}},
 'message': ['You are planning your trip in Cambridge',
  "You are looking for a <span class='emphasis'>place to stay</span>. The hotel should <span class='emphasis'>include free parking</span> and should <span class='emphasis'>include free wifi</span>",
  "The hotel should be in the type of <span class='emphasis'>guesthouse</span> and should be in the <span class='emphasis'>east</span>",
  "Once you find the <span class='emphasis'>hotel</span> you want to book it for <span class='emphasis'>5 people</span> and <span class='emphasis'>5 nights</span> starting from <span class='emphasis'>thursday</span>",
  "If the booking fails how about <span class='emphasis'>friday</span>",
  "Make sure you get the <span class='emphasis'>reference number</span>",
  "You are also looking for a <span class='emphasis'>train</span>. The train should <span class='emphasis'>arrive by 14:00</span> and should be on <span class='emphasis'>the same day as the hotel booking</span>",
  "The train should depart from <span class='emphasis'>stansted airport</span> and should go to <span class='emphasis'>cambridge</span>",
  "Once you find the train you want to make a booking for <span class='emphasis'>the same group of people</span>",
  "Make sure you get the <span class='emphasis'>reference number</span>"],
 'restaurant': {}}```
budzianowski commented 4 years ago

Hi, thanks for spotting this! I will double check if there are other occurrences like that and update the goal message.

budzianowski commented 4 years ago

I updated the messages in dialogues that had this field missing and I added the missing field. This should fix the inconsistency. Otherwise it doesn't affect the final outcomes of the dialogue.