Models like GAN has several modules wrapped with bagua separately. Current autotune implementation will lead to crash in this case, since newly registered model will overwrite the information on the autotune server.
We can consider adding a model name based on with_bagua invocation time (like bagua_model_1, bagua_model_2, ...), and maintain each model's hyperparameter separately on the autotune service.
Models like GAN has several modules wrapped with bagua separately. Current autotune implementation will lead to crash in this case, since newly registered model will overwrite the information on the autotune server.