Open nitba opened 4 years ago
Hi @Ivamcoder,
Were you able to figure this out ?
I don't recall having memory issues for this.
Best !
I couldn't resolve, it is cpu memory issue, occupied cpu memory grows by increasing number of passed epochs; at epoch 50 it reaches to 128G
Hi @hassony2 , Thanks for sharing the code, I have treid second stage of training; meshwarp; after some epochs, for me 50 epochs, occupied memory goes around 128 G, I do not have an idea why it happens?