search

Lightning-AI / pytorch-lightning

Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
https://lightning.ai
Apache License 2.0
28.53k stars 3.39k forks source link

Support skipping the first iteration time in process bar #19357

Open jiarenyf opened 10 months ago

jiarenyf commented 10 months ago

Description & Motivation

Because the first iteration time is incorrect (model initialization and torch.compile when first interation)

Pitch

No response

Alternatives

No response

Additional context

No response

cc @borda @awaelchli @carmocca

awaelchli commented 9 months ago

I agree it would be nice if we could re-init the progress bar automatically after the first or so iterations. With the current progress bar implementation, this is doable but not trivial.