ivadomed / utilities

Repository containing utility scripts for handling various aspects in a DL model training pipeline
MIT License
8 stars 0 forks source link

How are model checkpoints packaged? #32

Open hermancollin opened 11 months ago

hermancollin commented 11 months ago

How are model checkpoints usually dealt with? For example in https://github.com/ivadomed/model_seg_sci/tree/main I don't see any models. They are not listed in the repo assets either

jcohenadad commented 11 months ago

Great question. Here are two examples of model checkpoints:

The idea is to refer to these checkpoints in 3rd party software using these models. For example in SCT we have this file that does that.

hermancollin commented 11 months ago

Thanks @jcohenadad. The model_seg_mouse-sc_wm-gm_t1 example is what I was looking for. In short, this was the content of the asset: Screenshot_20230920_094911 Only the selected fold is included, but validation results are also present. The filesize is further reduced by only keeping best or final checkpoint.

naga-karthik commented 11 months ago

I was a bit concerned about how large the assets in a release can get (because nnUNet models are heavy). But their documentation says that:

Each file included in a release must be under 2 GiB. There is no limit on the total size of a release, nor bandwidth usage.

(which is good)