interTwin-eu / itwinai

Advanced AI workflows for digital twins applications in science.
https://itwinai.readthedocs.io
MIT License
14 stars 5 forks source link

Tutorial on TF dataloder when running distributed ML #185

Open matbun opened 3 months ago

matbun commented 3 months ago

Better explain how to replicate dataset and how batch size is managed across workers. Please reference the code in the TensorflowTrainer: https://itwinai.readthedocs.io/latest/_modules/itwinai/tensorflow/trainer.html#TensorflowTrainer