TF dataset from generator: unknown number of iterations in first epoch

frankkramer-lab / aucmedi

a framework for Automated Classification of Medical Images

https://frankkramer-lab.github.io/aucmedi/

GNU General Public License v3.0

38 stars 12 forks source link

TF dataset from generator: unknown number of iterations in first epoch #190

Closed muellerdo closed 1 year ago

muellerdo commented 1 year ago

It works, but looks quite weird. Just Tensorflow fun...

    634/Unknown - 519s 803ms/step - loss: 1.6051 - auc: 0.7237 - f1_score: 0.2

Fix: Estimate length of dataset via cardinality or estimate length via dataset length//batch_size and set steps_per_epoch manually if iterations==None

Refs: https://discuss.tensorflow.org/t/typeerror-dataset-length-is-unknown-tensorflow/948/10 https://colab.research.google.com/drive/1RVMlCTyZZ-OSdBX6AOrs165ieyTn57Ds?usp=sharing

muellerdo commented 1 year ago

Withdraw from tf.datasets. See issue: #194