Fix out-of-range token crash in OpenAI endpoint

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine

https://pygmalion.chat

GNU Affero General Public License v3.0

606 stars 78 forks source link

Closed 50h100a closed 2 weeks ago

50h100a commented 2 weeks ago

Sterilize bias dict token range according to active model. Now uses BiasLogitsProcessor tensors and all.