search

facebookresearch / simmc

With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduce two new datasets (both in the virtual shopping domain), the annotation schema, the core technical tasks, and the baseline models. The code for the baselines and the datasets will be opensourced.
Other
131 stars 36 forks source link

Baselines results #19

Closed seo-95 closed 4 years ago

seo-95 commented 4 years ago

Baselines result in mm_action_prediction/README.md does not match result in the paper. Which are the official baselines result we should refer to?

satwikkottur commented 4 years ago

Hello @seo-95 ,

As mentioned just above here, the baseline results in the paper are on a subset of data that is different from these official splits.

Please use the numbers in mm_action_prediction/README.md as the official baseline results.