Thanks for this! It creates a little bit of a semantic clash though - when the checkpoint is latest, it uses results_dir; when it's a path, it assumes a full path. I think it would be fine to make it so when eval_single_checkpoint is a filename, it still uses results_dir to create the full path. WDYT?
Thanks for this! It creates a little bit of a semantic clash though - when the checkpoint is
latest, it usesresults_dir; when it's a path, it assumes a full path. I think it would be fine to make it so wheneval_single_checkpointis a filename, it still usesresults_dirto create the full path. WDYT?