search

salaniz / pycocoevalcap

Python 3 support for the MS COCO caption evaluation tools
Other
293 stars 82 forks source link

Enable verbosity control of PTBTokenizer #12

Closed j-min closed 1 year ago

j-min commented 3 years ago

PTBTokenizer logs tokenization details by default (ex. PTBTokenizer tokenized 2 tokens at 33.87 tokens per second). This becomes noisy when you have run tokenization iteratively. I redirect stderr to subprocess.DEVNULL to suppress this.

salaniz commented 1 year ago

Sorry for only getting to it now. This change looks good to me. It might make sense to extend this idea to the whole evaluation pipeline and it's stdout as I feel that alone can be to noisy.