I am reading the pretraining and finetuning loss function and am trying to understand the implementation of this loss:
I think I have a general idea of implementation, but would like to confirm in case I am not missing any details.
The idea I have is as follows:
For each variable calculate the MAE loss
Multiply each variable loss by specific variable weight.
Sum loss of variables grouping by Surface variables and Atmospheric Variables separately
Multiply Surface and Atmospheric losses by alpha and beta weights respectively
Finally sum losses together and multiply by (dataset weight/(tot # variables in dataset)
I am reading the pretraining and finetuning loss function and am trying to understand the implementation of this loss:
I think I have a general idea of implementation, but would like to confirm in case I am not missing any details. The idea I have is as follows:
For each variable calculate the MAE loss Multiply each variable loss by specific variable weight. Sum loss of variables grouping by Surface variables and Atmospheric Variables separately Multiply Surface and Atmospheric losses by alpha and beta weights respectively Finally sum losses together and multiply by (dataset weight/(tot # variables in dataset)