With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduce two new datasets (both in the virtual shopping domain), the annotation schema, the core technical tasks, and the baseline models. The code for the baselines and the datasets will be opensourced.
Other
131
stars
36
forks
source link
Building multimodal inputs handles unseen retrieval utterances; #47 #48
@satwikkottur merged this pull request in facebookresearch/simmc@005a72bbed1b719b9756165f43ed0ca5469d10bf.