Closed carstendraschner closed 1 month ago
Hello :)
This PR fixes issues with Inference by using local chat. as local chat overwrites build transformer of Base it does not include the default padding = left which is needed for inference. The PR only changes the one needed line.
regards Carsten
Hello :)
This PR fixes issues with Inference by using local chat. as local chat overwrites build transformer of Base it does not include the default padding = left which is needed for inference. The PR only changes the one needed line.
regards Carsten