chenfei-wu / TaskMatrix

Other
34.51k stars 3.32k forks source link

evaluation without using gradio? #380

Open CCYChongyanChen opened 1 year ago

CCYChongyanChen commented 1 year ago

Hi, thanks for the great work! I would like to evaluate visual chatgpt on some datasets... Is there any way to do that instead of using gradio? Such as directly passing the image/text to the model with CLI? I only need one round chat so no history needed and I am not sure how to handle the history message and the state for gradio. Any suggestions are appreciated.