Closed frodre closed 11 months ago
Add validation specific to the SST reservoir training along with wanb logging and the capability to update configuration via wandb (for sweeps). Also add sweep initialization, job submission, and configuration scripts.
Example wandb sweep Example wandb training validation
Refactored public API:
ReservoirTrainingConfig
mask_readout
mask_field
validate_sst_only
Transformer
fv3fit.dump
Significant internal changes:
Adds a set state method to the reservoir for usage in testing/notebooks
set state
[ ] Tests added
Coverage reports (updated automatically):
Add validation specific to the SST reservoir training along with wanb logging and the capability to update configuration via wandb (for sweeps). Also add sweep initialization, job submission, and configuration scripts.
Example wandb sweep Example wandb training validation
Refactored public API:
ReservoirTrainingConfig
now takes two more flags:mask_readout
: option to mask readout alongside reservoir input ifmask_field
is present in the datavalidate_sst_only
: enables the SST-specific wandb validation instead of the validation used for the atmospheric reservoirTransformer
paths in the config can now be remote pathsfv3fit.dump
can now dump to remote paths even when subcomponents are not remote compatibleSignificant internal changes:
Adds a
set state
method to the reservoir for usage in testing/notebooks[ ] Tests added
Coverage reports (updated automatically):