Open rotem-benzvi opened 2 years ago
In the current codebase, you use the test set as validation and perform early stopping (checkpoint selection) based on it. When fixing this and using the correct validation set performance drop significantly, is there something I am missing?
Hello! I am a beginner in the field of STR. I also found this problem when learning ABINet. Have you come across other algorithms that use the test set as validation to perform early stopping? My previous knowledge tells me that practice is relatively rare.
Hi, this codebase follows the setting as previous algorithms in this field just for a fair comparison. You can also refer to previous implementations.
In the current codebase, you use the test set as validation and perform early stopping (checkpoint selection) based on it. When fixing this and using the correct validation set performance drop significantly, is there something I am missing?