search

cvlab-columbia / viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
Other
1.63k stars 117 forks source link

Can you provide prompts for ChatGPT 3.5? #44

Open k1tano opened 5 months ago

k1tano commented 5 months ago

I've encountered significant performance gaps while reproducing your work. I understand that your work is based on code-davinci-002, and ViperGPT's performance on ChatGPT 3.5 seems far from what is mentioned in your paper. Could you offer prompts designed for ChatGPT (such as Refcoco dataset)? This is crucial for my work, and I appreciate your assistance!

surisdi commented 5 months ago

Hi @k1tano, we did not run any experiments with ChatGPT 3.5, so we do not have prompts that work specifically for it (nor GPT-4, nor CodeLlama). If you manage to find prompts that work better for ChatGPT 3.5, we would appreciate it if you can share them.