issues
search
EvolvingLMMs-Lab
/
lmms-eval
Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.03k
stars
53
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
03-25 13:08:56 [lmms_eval/models/llava.py:382] ERROR Error LlavaLlamaForCausalLM.forward() got an unexpected keyword argument 'cache_position' in generating
#30
awzhgw
opened
3 months ago
1
Local dataasets config didn't work
#29
lucasjinreal
opened
3 months ago
0
add_ocrbench
#28
echo840
closed
3 months ago
1
Performance about cuda version
#27
xmu-xiaoma666
opened
3 months ago
1
upload dataset
#26
echo840
closed
3 months ago
0
lmms_eval/evaluator.py", line 83, in simple_evaluate assert tasks != [], "No tasks specified, or no tasks found. Please verify the task names." AssertionError: No tasks specified, or no tasks found. Please verify the task names.
#25
lucasjinreal
opened
3 months ago
6
[Fix] Fix llava reproduce error
#24
kcz358
closed
3 months ago
0
How to load dataset in offline mode?
#23
pipixin321
closed
3 months ago
2
How to debug in vscode
#22
xmu-xiaoma666
closed
3 months ago
1
Config will not be added to registry
#21
xienan0326
opened
3 months ago
2
/exact_match/exact_match.py. Module 'exact_match' doesn't exist on the Hugging Face Hub either.
#20
lucasjinreal
opened
3 months ago
1
Unable to reproduce llava evaluation
#19
jacob-hansen
closed
3 months ago
7
Module 'exact_match' doesn't exist on the Hugging Face Hub either.
#18
xienan0326
closed
3 months ago
5
Refcoco Metric
#17
Jiahaohong
opened
3 months ago
0
Unit of data in More Results
#16
Jiahaohong
closed
3 months ago
1
How to specify dataset paths?
#15
Jiahaohong
opened
3 months ago
12
MathVista Eval Support
#14
yqy2001
closed
3 months ago
1
[Tasks] Fix MMBench
#13
pufanyi
closed
3 months ago
0
[Feature] Evaluate model with 2gpu per process.
#12
tzjtatata
closed
3 months ago
5
few-shot test error
#11
youngwanLEE
closed
3 months ago
2
cmmmu
#10
phellonchen
closed
3 months ago
3
update version to 0.1.1
#9
pufanyi
closed
3 months ago
0
Typo in results sheet for llava-v1.6-vicuna-7b
#8
FGiuliari
closed
3 months ago
1
Fix mmbench dataset submission format
#7
pufanyi
closed
3 months ago
0
quetions about the evals
#6
CrossLee1
closed
3 months ago
4
a bug for "exact_match"
#5
mary-0830
closed
3 months ago
4
[Feat] add correct tensor parallelism for larger size model.
#4
Luodian
closed
3 months ago
0
Not Support LLava 1.6or llava-Next?
#3
BlueBlueFF
closed
3 months ago
3
llava_bench_wild seems not a valid parameter
#2
wusize
closed
3 months ago
1
pip package
#1
pufanyi
closed
3 months ago
0
Previous