THUDM / CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型
Apache License 2.0
6.14k stars 420 forks source link

How to evaluate the performance? #510

Open Originlightwkp opened 4 months ago

Originlightwkp commented 4 months ago

System Info / 系統信息

cuda 12.1 pytorch 2.3.1

Who can help? / 谁可以帮助到您?

No response

Information / 问题信息

Reproduction / 复现过程

My test results are as follows, is this considered good or bad?

[2024-07-19 09:38:21,589] [INFO] [RANK 0] validation loss at the end of training for test data | loss: 0.000000E+00 | PPL: 1.000000E+00 acc 5.319865E-02 | acc_w/o_case 5.319865E-02 |

Expected behavior / 期待表现

None

gyjlll commented 4 months ago

Can you run evaluate_cogagent_demo.py correctly without reporting an error?