Closed TimZaman closed 5 years ago
Profile this. Possibly due to slow upload of tensorboard event files or model uploading.
Notice all of the jumps in the below figure relate to restarts of the optimizer.
Fixed in c30c1d9, due to uploading events/model to slow a.f. gcs;
Profile this. Possibly due to slow upload of tensorboard event files or model uploading.
Notice all of the jumps in the below figure relate to restarts of the optimizer.