search

thangvubk / FEQE

Official code (Tensorflow) for paper "Fast and Efficient Image Quality Enhancement via Desubpixel Convolutional Neural Networks"
MIT License
128 stars 19 forks source link

Out of memory of cpu with 32GB #3

Closed Rainyfish closed 5 years ago

Rainyfish commented 5 years ago

When producing the .npz file. program will exit with out of memory. But my computer has 32GB cup memory. How larger is your CPU memory?

thangvubk commented 5 years ago

If I'm not wrong, you mentioned out of memory in RAM. My server has 128G RAM. For the first run, it takes quite much memory for the writing operation. I have some suggestions for u:

  1. Try to train with half of the training dataset.
  2. You can load directly from images instead of writing to a bin file but it might be much slower in training.
Rainyfish commented 5 years ago

Thank you for your suggestions, I will transform every image to .npz files and load the all the npz file in the RAM. Or can you release the .npz files that you built in your machine?

thangvubk commented 5 years ago

Since the bin files are also big, please try the suggestions first to see if they help or not :D