graykode / xlnet-Pytorch

Simple XLNet implementation with Pytorch Wrapper
https://arxiv.org/pdf/1906.08237.pdf
Apache License 2.0
576 stars 107 forks source link

Batch training #14

Open tonyzhao6 opened 4 years ago

tonyzhao6 commented 4 years ago

@graykode Can you explain how batch training would be conducted? For example, what if we had multiple input files for training data?

Currently, training is done using only a single data file. For multiple data files, would data_utils._create_data have to return a batch of features?