Open lilakk opened 3 days ago
Hi all, if I want to train for a specific number of epochs rather than steps, is it okay to just set epoch_size to None when creating the SortByLengthDataset here? Would that cause any issues for the replicated data streaming processes?
epoch_size
SortByLengthDataset
Hi all, if I want to train for a specific number of epochs rather than steps, is it okay to just set
epoch_size
to None when creating theSortByLengthDataset
here? Would that cause any issues for the replicated data streaming processes?