We're killing our free space on wandb. I keep deleting old runs which I will probably regret.
[x] Better scheduling of plots (usually we want something logarithmic - higher frequency at the beginning, slower later)
I'm not sure I want to have separate schedules for model checkpoints and plots, so I'll leave this as is for now.
[x] Option to disable e.g. fourier analysis, and generally provide more fine grained control for both disk space and compute reasons.
[x] Allow for plotting both locally and wandb (right now they're exclusive)
Now just moved wandb dir to within the run_dir of the simulation, which saves all of its output anyway. Not as organized, but I think better than making two copies of every plot.
[x] Make plots that denormalize images be sensitive to normalization settings
We're killing our free space on wandb. I keep deleting old runs which I will probably regret.
Better scheduling of plots (usually we want something logarithmic - higher frequency at the beginning, slower later)Allow for plotting both locally and wandb (right now they're exclusive)