microsoft / M3P

Multitask Multilingual Multimodal Pre-training
MIT License
68 stars 9 forks source link

text preprocess #15

Open LiJiaBei-7 opened 2 years ago

LiJiaBei-7 commented 2 years ago

How can I get the data in preprocess.py , such as vocab.txt, tran.txt and train.txt.pth? Can you tell me more about the process? Thanks in advance