analogdevicesinc / ai8x-training

Model Training for ADI's MAX78000 and MAX78002 Edge AI Devices
Apache License 2.0
86 stars 76 forks source link

Resume training for NAS #281

Closed daemonkillerr closed 4 months ago

daemonkillerr commented 6 months ago

Hi, I stopped the training after NAS stage 1 level 1 checkpoint got saved. Now I want to resume training.

Should I:

  1. --nas-kd-resume-from logs/2024.01.03-123840/checkpoint.pth.tar --resume-from logs/2024.01.03-123840/nas_stg1_lev1_checkpoint.pth.tar

  2. --resume-from logs/2024.01.03-123840/nas_stg1_lev1_checkpoint.pth.tar

Thank you

MaximGorkem commented 6 months ago

Second option. You have to call --resume-from to continue NAS training.

--nas-kd-resume-from is for loading the teacher if you use knowledge distillation with NAS.

github-actions[bot] commented 5 months ago

This issue has been marked stale because it has been open for over 30 days with no activity. It will be closed automatically in 10 days unless a comment is added or the "Stale" label is removed.