As of right now there are three subdirectories which are concerned with the different experiment types:
experiment: Provides the 'shell' for submitting an experiment on different platforms.
multi_runner: Provides helpers which launch single/multi seed/config runs.
launch: Provides the outer entry point for the different experiment types. This is what is ultimately called in mle run.
I think it may make sense to either rename multi_runner to something that makes more sense or to merge it into experiments. We should also think about how this will integrate with the different cloud platforms and how we want to rsync/gsync files.
As of right now there are three subdirectories which are concerned with the different experiment types:
experiment
: Provides the 'shell' for submitting an experiment on different platforms.multi_runner
: Provides helpers which launch single/multi seed/config runs.launch
: Provides the outer entry point for the different experiment types. This is what is ultimately called inmle run
.I think it may make sense to either rename
multi_runner
to something that makes more sense or to merge it intoexperiments
. We should also think about how this will integrate with the different cloud platforms and how we want to rsync/gsync files.