-
Hi! Thanks for your great work.
Could you please release the following evaluation codes？
model_video_chatgpt_general.py
eval_activitynet_qa.py
model_video_detail_description.py
-
Traceback (most recent call last):
File "/home/ubuntu/taoyu/LLaVA-NeXT/llava/eval/model_video_detail_description.py", line 197, in
run_inference(args)
File "/home/ubuntu/taoyu/LLaVA-NeXT/l…
-
### Question
Table 1 in this paper showed that the accuracy of SeedBench on vanilla LLaVA-1.5-7B is 60.5. However, when I tried to reproduce this one, I got 66.2 which is higher than that.
_No respo…
-
This appears to be an upstream issue, but I am adding it here to inform should the issue, should it come up with another user. I am experiencing the same problem. It is a shame that there doesn't appe…
-
https://github.com/EvolvingLMMs-Lab/lmms-eval/blob/24dc435908d921e9f1a5706e3141b12e5d838d18/lmms_eval/models/instructblip.py#L9
It seems that the mmmu task does not have this utils_group_img file.
-
[logging] The program is not responding during multi-gpu evaluation.
The program froze and did not respond during multi-gpu evaluation.
After checking the code, I've noticed that multi-gpu evaluat…
-
This would allow users to use the UI layout they want.
Instead of making a single window layout like #1911 OR detachable windows like #3532 we could have all UI layouts.
The user themselves choos…
-
(Click to enlarge)
---
Hi all,
My previous work for Zynaddsubfx has sam…
-
whether the Monkey model can be used for commercial purposes? Or Do you support the [Apache-2.0]?
-
On master branch LMMS process keeps running after exit.
I just open and close LMMS without loading any project.
I'm using Manjaro Linux and SDL audio interface.
This doesn't happen in stable-1.2 br…