-
The desired outcome should print "True":
The error I am receiving is this:
![image]…
-
Is there any scripts for evaluation of MiniGPT-4? For example, is there scripts for evaluating MiniGPT-4 on benchmarks considered in the MiniGPT-v2 paper?
Any reference or suggestions are apprecia…
-
Running the tasks with `BAAI/bge-visualized-base-base/m3` and getting errors like below
```
ERROR:mteb.evaluation.MTEB:Error while evaluating InfoSeekIT2TRetrieval: The size of tensor a (516) must m…
-
When I want to run the 1024 video, something wrong with the shape of mask and input.
> Traceback (most recent call last):
> File "scripts/evaluation/inference_freenoise.py", line 147, in
> …
-
```
ERROR:mteb.evaluation.MTEB:Error while evaluating Winoground: DatasetInfo.__init__() got an unexpected keyword argument 'task_templates'
Traceback (most recent call last):
File "/data/niklas/…
-
Hi，
I would like to express my sincere gratitude for your excellent work. I'm trying to reproduce the subtype evaluation part and I'm wondering if there are any additional processing steps or scripts…
-
### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior …
-
Thanks for releasing the codes of this awesome work!
Could you please provide the evaluation scripts? Because I have confused with evaluation of multimodal completion. Thank you.
-
I have added the params for the model script.
But I need to add an evaluation script as well to test our model.
Need to: write the script and thing about the params for it.
-
Hi, I saw your work and wanted to examine it because it caught my attention. There was one thing that came to my mind during my review. As far as I understand, the affordance estimation network makes …