-
### Open5GS Release, Revision, or Tag
v2.6.0
### Components and subsystems
MME
### Proposed functionality
I'm creating this ticket to announce and track the implementation of a Gn (GTPv1C) inter…
-
How to load local data for evaluation
DEBUG /opt/conda/lib/python3.10/site-packages/lmms_eval-0.1.1-py3.10.egg/lmms_eval/tasks/mme/mme.yaml: No module named '/workspace/LLaVA/lmms-lab-local/MME'. C…
-
The model trends to output more words than a single option when multi choice, after upgraded vlmevalkit
-
It's mostly done already, assuming start dates can be aligned.
-
### Question
![image](https://github.com/haotian-liu/LLaVA/assets/163366727/6f8f825a-c8e4-472c-ade2-deb6da33428e)
-
- The evaluation of videoMME is very slow; it seems that the CPU is reading the video samples serially. Can this be optimized?
-
I try to reproduce the results under base recipe. I basically get the results in the paper on VQAv2, GQA, ScienceQA and POPE. But there is almost 1% gap on TextVQA, MMMU, and MM-Vet, and the gap on MM…
-
**Describe the bug**
Setting `sourcemap=true` in the `react-core` package results in a build error.
**To Reproduce**
Steps to reproduce the behavior:
1. Set `sourcemap=true` in the tsup config o…
-
Hi @herlesupreeth,
I deployed the open5gs and ims following the steps in guide on https://github.com/herlesupreeth/docker_open5gs/blob/master/README.md
And I'm using a Huawei Mate 30, now the da…
-
We find the results are slightly different when evaluating the same model on the original MME benchmark and lmms-eval, we compare the generated responses and find the responses for 000000494869.jpg ar…