NKI-AI / ahcore

Ahcore is the AI for Oncology core computational pathology toolkit
Apache License 2.0
15 stars 1 forks source link

Fix for OOM during inference #37

Closed AjeyPaiK closed 9 months ago

AjeyPaiK commented 9 months ago

Pytorch Lightning keeps track of all its outputs through one epoch. That is why, we observed the OOM error during the predict loop. If we disable the return_predictions flag, OOM errors don't occur anymore. For a detailed discussion on this, refer the comments on #19.