search

FangShancheng / ABINet

Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition
Other
420 stars 72 forks source link

Using the test as validation #57

Open rotem-benzvi opened 2 years ago

rotem-benzvi commented 2 years ago

In the current codebase, you use the test set as validation and perform early stopping (checkpoint selection) based on it. When fixing this and using the correct validation set performance drop significantly, is there something I am missing?

icecream-Tnak commented 2 years ago

In the current codebase, you use the test set as validation and perform early stopping (checkpoint selection) based on it. When fixing this and using the correct validation set performance drop significantly, is there something I am missing?

Hello! I am a beginner in the field of STR. I also found this problem when learning ABINet. Have you come across other algorithms that use the test set as validation to perform early stopping? My previous knowledge tells me that practice is relatively rare.

FangShancheng commented 2 years ago

Hi, this codebase follows the setting as previous algorithms in this field just for a fair comparison. You can also refer to previous implementations.