-
### Describe the feature
For now, only MiniGPT-4 is supported with MME dataset. I wonder if it's possible to further support MLLMs like Instruct Blip and LLaVA.
I also have a problem about the MME…
-
### Describe the bug
prompt是采用multimodal/models中的minigpt4和instructblip中的样例进行prompt吗?还是有设计prompt,我是用样例的简单prompt复现mplug时远不及论文中的验证集的49%
'''python
img_prompt = '###Human: '
if '…
-
The performance of GIT2 in the leaderboard is quite impressive. It only has 5.1B parameters. The original paper was published in 2022 and their repository has not been updated since March 2023. The or…
-
Hi~ Nice work!
The paper mentioned that LISA has the capability of multi-turn conversation.
I would like to know how LISA get this capability?
Is the training instruction data containing multi-tu…
-
Thanks for your awesome work!
I just want to know the disparity of the speeds between DPR and FLMR (or PREFLMR)
Looking forward to your reply
-
Hi, thanks for curating this awesome list! There is a recent paper that evaluates several MLLM (InstructBLIP, BLIP2 etc) on more challenging human exam questions requiring images:
M3Exam: A Multili…
-
Awesome work!
Will you share the training or fintuning code?
-
Dear authors,
Thanks for the great work! I've encountered a **RuntimeError: Internal: unk is not define** when running
```accelerate launch --num_processes 4 \
--main_process_po…
-
Just did a very simple run with llama-7b-4bit. It... took a while. Had it run in a screen. But, it worked!
```
root@FriendlyWrt /s/o/llama.cpp (master)# time ./main --color -m models/ggml-model-q4…
-
Hello, I installed Shikra according to the readme and downloaded the dataset.
I tried to perform inference but encountered an error during runtime.
The error is "ModuleNotFoundError: No module name…