remove pad tokens added by the accelerator.pad_across_processes

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Apache License 2.0

698 stars 180 forks source link

Open IQ17 opened 2 months ago

IQ17 commented 2 months ago

remove pad tokens added by the accelerator.pad_across_processes; otherwise it makes tasks like pal-gsmhard-majority_voting failed