When updating a GATModelConfig, if a value is passed for num_layers but the original config wasn't created from num_layers, this new values is ignored. This causes issues for eg sweeps, where we might have an original model that was just built from default hyperparams but we want to sweep across different numbers of layers.
When updating a
GATModelConfig, if a value is passed fornum_layersbut the original config wasn't created fromnum_layers, this new values is ignored. This causes issues for eg sweeps, where we might have an original model that was just built from default hyperparams but we want to sweep across different numbers of layers.