ufal / npfl122

NPFL122 repository
Creative Commons Attribution Share Alike 4.0 International
13 stars 24 forks source link

Parametrize az_quiz players with seeds for reproducibility #107

Closed 3nol closed 1 year ago

3nol commented 1 year ago

I parametrized the az_quiz_player_random, az_quiz_player_simple_heuristic, and az_quiz_player_fork_heuristic with seeds for easier az_quiz_agent hyperparameter debugging. Also makes the evaluation reproducible.

foxik commented 1 year ago

Good idea!

However, I would like the fork heuristic to also have instance-specific random generator, so I updated your commit to pass also an instance-based generator in the fork heuristic.

Furthermore, I use args.seed as the default seed for all the players, and I have updated the evaluator to allow overriding the individual player seeds with the --seed evaluator argument, if the seeds of the individual players are None.

A community-work point is yours for your contribution :+1: