drscotthawley / panotti

A multi-channel neural network audio classifier using Keras
MIT License
271 stars 72 forks source link

Error after run train_network.py but not always #26

Closed globalik closed 6 years ago

globalik commented 6 years ago

Hi i got error after run train_network.py but not everytimes. I trained on my graphics card. One class is allways 40 npy files. If used 2 classes (80 npy files) everythng work correctly, If used 4 classes (160 npy files) and i got a error (i thing that it's memory problem but i don't know) This is errorlist: https://pastebin.com/iFTNVEQn

My laptop specification: OS: Windows 10 Graphics card: Nvidia GTX 950m 2GB RAM: 8GB DDR4

I finally want used 10 classes but at this moment work only 2 classes

Please help me.

drscotthawley commented 6 years ago

Hi @globalik. Looks like you're running on a Windows system, which as it says in the README, I have no experience with. Also looks like you're getting "out of memory" errors from tensorflow. Which, given that you've only got 8GB of RAM and only 2GB of VRAM seems entirely appropriate. This agrees with your ability to run 2 classes but not 4.

One simple thing you could try would be to decrease the batch size. There's a command-line parameter "--batch_size" that defaults to 40. Try running train_network.py with --batch_size=10.

If that doesn't work, then my recommendation is that you try running on a non-Windows system with more RAM & VRAM. Perhaps an AWS g2_2xlarge Ubuntu instance.

globalik commented 6 years ago

thanks this solution works.