About time cost on pre-training with corpus Wikipedia.

microsoft / ProphetNet

A research project for natural language generation, containing the official implementations by MSRA NLC team.

MIT License

654 stars 105 forks source link

About time cost on pre-training with corpus Wikipedia. #30

Open bescks opened 3 years ago

bescks commented 3 years ago

Hi, It is a awesome model and I am going to reproduce the result from end to end. Before I start working on this, can you tell me how many hours it will cost if I do pre-training on my own device(dataset : 16GB corpus Wikipedia + BookCorpus with 64 epochs , hardware: 8 * NVIDIA V100 (32GB))?