Psycoy / MixEval

The official evaluation suite and dynamic data release for MixEval.
https://mixeval.github.io/
196 stars 28 forks source link

Problem in Inference of Local Chat Model #23

Closed carstendraschner closed 1 month ago

carstendraschner commented 1 month ago

Hello :)

I face an Issues with Inference by using local chat. as local chat overwrites build transformer of Base it does not include the default padding = left which is needed for inference. I created a PR to solve this issue:

https://github.com/Psycoy/MixEval/pull/22

regards Carsten

Psycoy commented 1 month ago

Hi Carsten, thank you for your contribution! I have merged the pull request