search

AllenCell / allencell-segmenter-ml

Napari plugin for ml segmentation
Other
1 stars 0 forks source link

Display progress during first epoch #379

Open yrkim98 opened 4 months ago

yrkim98 commented 4 months ago

Since the first epoch takes a long time, and the progress bar is frozen at this time, we should show the user some progress during this.

I think some sort of message that is displayed as each image is processed would be good, if we decide to keep the progress bar as it is.

@benjijamorris we discussed this a while ago, and you mentioned theres a way to look for progress during this first epoch, can you specify here

benjijamorris commented 4 months ago

yeah! During the first epoch, if cache_dir is set, the data loader will save out the result of the deterministic transforms as a .pt file in the cache_dir. If we know the total number of images, this could be a proxy for first epoch progress as the first epoch is usually bottlenecked by data loading and caching. After the first epoch, training examples are loaded from the cache and this is much faster.