cvlab-columbia / viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
Other
1.63k stars 117 forks source link

Any plans to include the video API in chatapi.prompt? #13

Closed devaansh100 closed 1 year ago

devaansh100 commented 1 year ago

I was hoping to run VideoQA using ViperGPT, however, since Codex was discontinued, the same was not possible with ChatGPT. Have you explored other API prompts for videos to work in the same context window?

sachit-menon commented 1 year ago

Sorry for not catching this -- we haven’t tried with video in the shorter context window, probably the best way would be to remove the image functions you don’t need and paste the VideoSegment class back in. (It does fit including the video parts for GPT-4 if you can get access to that.)