adds save and restore capabilities to trainer and algorithm

numenta / nupic.embodied

GNU Affero General Public License v3.0

6 stars 6 forks source link

adds save and restore capabilities to trainer and algorithm #48

Closed lucasosouza closed 2 years ago

lucasosouza commented 2 years ago

Main changes:

Adds save and restore capabilities to trainer and algorithm - no longer dependent on aarage's snapshotter
Sets wandb and checkpointing to the same folder
Fixes bug in alpha optimizer initialization in garage MTSAC
removes custom sac algorithm, no longer needed
renames Custom Trainer to just Trainer - no longer inherits from garage Trainer.

Saving and loading have been unit tested. Requires regression testing.

abhi-iyer commented 2 years ago

Pushed changes to fix the wandb resume functionality.

lucasosouza commented 2 years ago

@abhi-iyer Added capability of restoring from latest experiment by providing flag -r. Can also provide project id through command line through flag -p, that will override the project_id given in config.

Moved from namedtuples to dataclasses only