search

fchollet / deep-learning-with-python-notebooks

Jupyter notebooks for the code samples of the book "Deep Learning with Python"
MIT License
18.59k stars 8.63k forks source link

regular spikes in loss (cats-and-dogs notebook) #191

Open markusloecher opened 2 years ago

markusloecher commented 2 years ago

I am struggling with explaining the regular spikes in both training and validation losses observed when running the cats-and-dogs CNN from the book, see image below:

image

There is an interesting discussion of a very similar issue on SO:

Why does my training loss have regular spikes?

, but my data size is an integer multiple of the batch size, so the explanation does not hold for me. I am unable to explain the sharp spikes and the steep drops in training loss at the end/beginning of each epoch.

I am happy to provide the notebook I used.

Thx!

ifond commented 2 years ago

YES!!! I have received your E-mail——Steven Lee