To improve the test tool, when testing model with tools/test.py and "--save-preds" option.
Modification
When the test_evaluator config is a dict and --save-preds is in tools/test.py's option, the runner cannot correctly buid the evaluator.For example:
My config file
Motivation
To improve the test tool, when testing model with tools/test.py and "--save-preds" option.
Modification
When the
test_evaluator
config is a dict and--save-preds
is intools/test.py
's option, the runner cannot correctly buid the evaluator.For example: My config fileMy test script
the
--save-preds
option will concat the evaluator with aDumpResults
instance in a wrong way,the new evaluator is like:This new
test_evaluator
cannot be built by program.After updating the
tools/test.py
, using the same config and test scripts, the newtest_evaluator
will be:This new
test_evaluator
can be built correctly by program.Checklist
Before PR:
After PR: