Generate.py is consuming too large memory on GPU when handling large file

facebookresearch / access

Code to reproduce the experiments from the paper.

Other

101 stars 36 forks source link

Generate.py is consuming too large memory on GPU when handling large file #26

Closed vanh17 closed 3 years ago

vanh17 commented 3 years ago

I was wondering if we could break down the large file into smaller batches so that generate.py won't break down when dealing with large file contains 50-60k sentences to generate?

louismartin commented 3 years ago

Hi @vanh17 thanks for the issue! Yes you can break down the file into multiple smaller files and then use the generate.py script on each of them.

louismartin commented 3 years ago

Closing because no activity but feel free to reopen if you have more questions.