search

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine
https://pygmalion.chat
GNU Affero General Public License v3.0
660 stars 80 forks source link

Mirostat v2 Fix #73

Closed 50h100a closed 7 months ago

50h100a commented 7 months ago

Miro alters the logits and then re-normalizes them in order to sample.

Normalizing and sampling the surprise values seems ill-advised.

50h100a commented 7 months ago

miro's unlikelihood calculation uses log2, not the natural logarithm.

50h100a commented 7 months ago

forgot i had this open lmao