Open xiu-ze opened 1 year ago
I want to run pretrain_t5.sh, but I don't know how should I preprocess data and the format of the data. Is the preprocess for t5 the same as gpt2 ?
I want to run pretrain_t5.sh, but I don't know how should I preprocess data and the format of the data. Is the preprocess for t5 the same as gpt2 ?