Request for Batch Sample Generation (with batch_size)

facebookresearch / SimulEval

SimulEval: A General Evaluation Toolkit for Simultaneous Translation

Creative Commons Attribution Share Alike 4.0 International

102 stars 36 forks source link

Request for Batch Sample Generation (with batch_size) #103

Open zhongmz opened 10 months ago

zhongmz commented 10 months ago

Impressed by Your Work!

I'm interested in whether the SimulEval Toolkit can support batch_size for generation. When generating on larger datasets, such as 2500 samples, using Falcon, it currently takes approximately 8 hours.

Warm regards, Meizhi Zhong