Appendix where?

[kanishkanarch]

Thank you for this wonderful work. There are multiple references to the Appendix or Appendix A inside your paper, but it is nowhere to be found. Kindly guide me where can I find the supplementary material for the research work.

[kanishkanarch]

Also, in the predictions.txt file of the pretrained model on the given dataset, the second row seems a bit off to me (see the image below). Second of the last three numbers denote the number of behaviour attributes, which should be 2 in the 2nd line, instead of 7. Also, please explain the meaning of other two of the three appended numbers

[ashwinipokle]

Thanks for your interest in this work. I have attached the pdf of Appendix here. Translating_Navigation_Instructions_in_Natural_Language_to_a_High_Level_Plan_for_Behavioral_Robot_Navigation__Supplementary_Appendix___.pdf

The second last number in each row indicates the number of tokens in the ground truth prediction. Therefore, as you pointed out, the prediction in the second row is incorrect as it is shorter.

The last number in each row is the Exact Match (EM) score (1 for correct and 0 for incorrect prediction)

This line from the codebase might be useful https://github.com/StanfordVL/behavioral_navigation_nlp/blob/981300f58c468f902c5fb2953be7eb4bff2376c5/codes/qa_model.py#L505

[kanishkanarch]

Thank you very much, Ashwini. I didn't know that you are also a BITSian 😃 Really inspiring work on machine translation!!!