NVlabs / progprompt-vh

ProgPrompt for Virtualhome
Other
106 stars 12 forks source link

gpt_version issuses #6

Open gaohan-cmd opened 8 months ago

gaohan-cmd commented 8 months ago

Hello, author. I am very interested in your work, but I have encountered some issues during the learning process and I hope to get your answers. I have set the "gpt_version" in the "run_eval.py" file to "gpt-3.5-turbo-instruct" and "gpt-3.5-turbo-instruct-0914". However, I noticed that when using these versions, all values for SR=0 are coming out as zero. Is this normal? Also, when using "code-davinci-002", it shows that the model does not exist. Could you please let me know which model versions I can use for training and testing under the current API key? Snipaste_2023-12-31_00-28-22 image