search

Vision-CAIR / MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
https://minigpt-4.github.io
BSD 3-Clause "New" or "Revised" License
25.4k stars 2.91k forks source link

Evaluation script for MiniGPT-4 #432

Open Yuancheng-Xu opened 11 months ago

Yuancheng-Xu commented 11 months ago

Is there any scripts for evaluation of MiniGPT-4? For example, is there scripts for evaluating MiniGPT-4 on benchmarks considered in the MiniGPT-v2 paper?

Any reference or suggestions are appreciated! Thanks!

DoggyLu commented 11 months ago

作者新出了评估脚本，但是我运行出现了该错误：huggingface_hub.utils.validators.HFValidationError: Repo id must use alphanumeric chars or '-', '', '.', '--' and '..' are forbidden, '-' and '.' cannot start or end the name, max length is 96: ''.

YushunXiang commented 11 months ago

I have the same question.

fjq-tongji commented 4 months ago

应该是readme里面的第2步没有做，就是下载一个LLM权重