search

facebookresearch / simmc

With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduce two new datasets (both in the virtual shopping domain), the annotation schema, the core technical tasks, and the baseline models. The code for the baselines and the datasets will be opensourced.
Other
131 stars 36 forks source link

Modifies evaluation scripts for single round evaluation #37

Closed satwikkottur closed 4 years ago

satwikkottur commented 4 years ago

Following changes are implemented in this PR:

  1. Change of saving format for retrieval results
  2. Include turn_id in all the saved formats
  3. All three evaluation scripts can now handle single round evaluation (action prediction, response generation and retrieval)
  4. Changes FLAGS to argparse in these files
facebook-github-bot commented 4 years ago

@satwikkottur merged this pull request in facebookresearch/simmc@36e53ddd7256304c77e073c7e2c3503ec2d3e86e.