Problem in Inference of Local Chat Model

Psycoy / MixEval

The official evaluation suite and dynamic data release for MixEval.

https://mixeval.github.io/

222 stars 34 forks source link

Problem in Inference of Local Chat Model #23

Closed carstendraschner closed 3 months ago

carstendraschner commented 3 months ago

Hello :)

I face an Issues with Inference by using local chat. as local chat overwrites build transformer of Base it does not include the default padding = left which is needed for inference. I created a PR to solve this issue:

https://github.com/Psycoy/MixEval/pull/22

regards Carsten

Psycoy commented 3 months ago

Hi Carsten, thank you for your contribution! I have merged the pull request