search

frankkramer-lab / aucmedi

a framework for Automated Classification of Medical Images
https://frankkramer-lab.github.io/aucmedi/
GNU General Public License v3.0
38 stars 12 forks source link

Rollback to keras.Sequence again? #194

Closed muellerdo closed 1 year ago

muellerdo commented 1 year ago

Looks like Sequences are more performant if you are using pure NumPy functions, due to from_generators() are not multi-processing capable.

You have to press all NumPy stuff in a dataset.map() functionality to allow multi-processing.

muellerdo commented 1 year ago

AUCMEDI now stays on keras.Sequences and withdraw from tf.datasets, as they do not scale reasonable in performance if utilizing preprocessing functions in a non tensorflow environment.