Fix non-batched implementation of logit bias

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine

https://pygmalion.chat

GNU Affero General Public License v3.0

606 stars 78 forks source link

Closed 50h100a closed 2 weeks ago

50h100a commented 2 weeks ago

also swapped function order to be consistent. Init, then Serial, then Batched.