search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
698 stars 180 forks source link

Run 70b evaluation. #235

Closed icoderzqliu closed 1 month ago

icoderzqliu commented 1 month ago

Hello, when I run the evaluation of the 70b model, I used 8*80G GPUs, but it still oom. How can I evaluate the the 70b model?