wessle / costaware

Repository for cost-aware project code.
MIT License
2 stars 0 forks source link

Plotter handles some experiments inappropriately #41

Closed wessle closed 3 years ago

wessle commented 3 years ago

Plotter appears to group data together by the name of the agent used. This makes it difficult to run an experiment that tests multiple hyperparameter configurations for a single type of agent, for example. This seems to be because

sns.lineplot(data=data, x='step', y='ratio', hue='agent',
             ci=self.confidence)

in Plotter.plot() forms groups using hue='agent'.

One flexible solution might be to group according to the name of subdirectories (e.g. AC_trials, Q_trials) instead of agents.

wessle commented 3 years ago

@DavidNKraemer

DavidNKraemer commented 3 years ago

Resolved in session today.