drethage / speech-denoising-wavenet

A neural network for end-to-end speech denoising
MIT License
673 stars 165 forks source link

Any way to prevent early stopping? #20

Open butterl opened 6 years ago

butterl commented 6 years ago

Hi, I'm using a P100 GPU and tried to retrained the model(pretrained is too large), but I found it always gose to early stopping at small epoch, any way to do more epoch ? I'm using default config and modified to used less memory by reducing "dilations" to 5

Epoch 34/250
1000/1000 [==============================] - 66s - loss: 0.0765 - data_output_1_loss: 0.0382 - data_output_2_loss: 0.0382 - data_output_1_mean_absolute_error: 0.0382 - data_output_1_valid_mean_absolute_error: 0.0382 - data_output_2_mean_absolute_error: 0.0382 - data_output_2_valid_mean_absolute_error: 0.0382 - val_loss: 0.0749 - val_data_output_1_loss: 0.0374 - val_data_output_2_loss: 0.0374 - val_data_output_1_mean_absolute_error: 0.0374 - val_data_output_1_valid_mean_absolute_error: 0.0374 - val_data_output_2_mean_absolute_error: 0.0374 - val_data_output_2_valid_mean_absolute_error: 0.0374
Epoch 00033: early stopping
NAM-hj commented 5 years ago

You can do more epochs, if you raise the value "early_stopping_patience" of 'config.json' file.