search

TheAtticusProject / cuad

CUAD (NeurIPS 2021)
https://www.atticusprojectai.org/cuad
388 stars 119 forks source link

convert squad examples to features very slow #12

Closed Saibo-creator closed 3 years ago

Saibo-creator commented 3 years ago

Hello, The step to convert squad examples to features is very slow on my machine:48 cores + GPU. The tqdm estimates 24 hours to finish. Is it normal? Thanks!

convert squad examples to features: 4%|██ | 865/22450 [20:16<24:52:42, 4.15s/it]

Saibo-creator commented 3 years ago

--threads argument helps

huberemanuel commented 2 years ago

Could you share the number of threads you used and the amount of memory that you have? Thanks!