biigle / maia

:m: BIIGLE module for the Machine Learning Assisted Image Annotation method
GNU General Public License v3.0
2 stars 3 forks source link

Training stops after first batch of epochs since TensorFlow upgrade #87

Closed mzur closed 2 years ago

mzur commented 2 years ago

It seems like the last TensorFlow upgrade broke the training procedure. When started in the default configuration, training just hangs after the first 10 epochs. This is the break where training should continue with the next 10 epochs but a different learning rate.

mzur commented 2 years ago

Some people suggest to disable multiprocessing with Keras in this case. In a manual test this seems to have worked.