thu-coai / ConvLab-2

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Apache License 2.0
450 stars 131 forks source link

[Feature] The user simulator always says something that is not clear #104

Closed ShaneTian closed 4 years ago

ShaneTian commented 4 years ago

Describe the feature For the following goal:

{
  "attraction": {
    "info": {
      "area": "west"
    },
    "reqt": {
      "entrance fee": "?",
      "phone": "?"
    }
  },
  "hotel": {
    "info": {
      "internet": "yes",
      "pricerange": "cheap",
      "type": "guesthouse"
    },
    "reqt": {
      "phone": "?"
    }
  },
  "taxi": {
    "info": {
      "arriveBy": "18:30"
    },
    "reqt": {
      "car type": "?",
      "phone": "?"
    }
  }
}

The user simulator said:

I ca n't wait to get there and see some of the local attractions . I am looking for a place to stay . Can you help me ? I also need a place to go in the west .

It is not clear for area slot value west

zqwerty commented 4 years ago

Template NLG generate a sentence for each slot-value. I also need a place to go in the west . comes from [Inform, Restaurant, Area, west]

ShaneTian commented 4 years ago

Thanks @zqwerty I mean, which one does in the west refer to in this sentence

We can't just tell by this sentence I also need a place to go in the west .

zqwerty commented 4 years ago

This is the error of templateNLG, I am looking for a place to stay . is redundant. fixed