Script for UnifiedQA and GPT-3

SilongYong / SQA3D

[ICLR 2023] SQA3D for embodied scene understanding and reasoning

Apache License 2.0

117 stars 3 forks source link

Script for UnifiedQA and GPT-3 #6

Open FreddieRao opened 1 year ago

FreddieRao commented 1 year ago

Hi, thank you for releasing the code and the benchmark. I'm wondering have you released the evaluation script on the UnifiedQA and GPT-3 training settings? Thank you!

NyanSequitur commented 1 year ago

Would also be interested in this, I'm curious since I can't seem to reproduce the 41% accuracy results on my own.

jeasinema commented 1 year ago

Thanks for your interest in our work! We're working on releasing the eval code for UnifiedQA and GPT-3. ETA in 1-2 weeks.

jeasinema commented 11 months ago

Sorry for the delay, it has been released here. Feel free to take a look and let me know if you need any help!