open-mmlab / mmaction2

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
https://mmaction2.readthedocs.io
Apache License 2.0
4.31k stars 1.25k forks source link

[Bug] different performance about batch size on val pipeline and test pipeline #2801

Open rkdckddnjs9 opened 8 months ago

rkdckddnjs9 commented 8 months ago

Branch

main branch (1.x version, such as v1.0.0, or dev-1.x branch)

Prerequisite

Environment

Describe the bug

Only the batch_size is different from the val pipeline and test pipeline, but the actual performance is significantly different. Does anyone know why that is?

Reproduces the problem - code sample

None

Reproduces the problem - command or script

None

Reproduces the problem - error message

None

Additional information

No response

WangChen100 commented 5 months ago

@rkdckddnjs9 Hi, I find the same problem. The performance of validation is different from the one through test pipeline with same configuration. Do you solve it?