CodeLLaMa stop tokens sometimes breaking

DNGros / lmwrapper

An object-oriented wrapper around language models (like openai endpoints or huggingface)

1 stars 1 forks source link

CodeLLaMa stop tokens sometimes breaking #18

Closed DNGros closed 1 year ago

DNGros commented 1 year ago

There seems to be some issues with CodeLLaMa stop tokens that breaks it sometimes. I will try to get a working reproduction and understand what's going on.

CC: @claudiosv

claudiosv commented 1 year ago

Thanks for the heads up. Let me know when you can repro it and I can probably fix it.