search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
771 stars 201 forks source link

add trust_remote_code and use_auth_token args #40

Closed loubnabnl closed 1 year ago

loubnabnl commented 1 year ago

Some models like SantaCoder require trust_remote_code=True, this PR adds this argument (along with use_auth_token)