remove pad tokens added by the accelerator.pad_across_processes

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Apache License 2.0

830 stars 219 forks source link

Open IQ17 opened 7 months ago

IQ17 commented 7 months ago

remove pad tokens added by the accelerator.pad_across_processes; otherwise it makes tasks like pal-gsmhard-majority_voting failed