fani-lab / LADy

LADy 💃: A Benchmark Toolkit for Latent Aspect Detection Enriched with Backtranslation Augmentation
Other
3 stars 3 forks source link

batch execution of nllb translation #35

Open hosseinfani opened 1 year ago

hosseinfani commented 1 year ago

nllb can translate at one a list of source sentences, esp, in the presence of gpu seems it gives speedup. We need to break the set of input reviews into batches and call nllb to balance speed and memory size.