feat(option): to set random seed

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

ISC License

10 stars 1 forks source link

feat(option): to set random seed #24

Closed grencez closed 1 year ago

grencez commented 1 year ago

I got a weird regression today where lots of characters like [ are being placed immediately after periods. Usually this means some token accounting is wonky... But It fixed itself after a rebuild.

Setting a random seed would diagnose these kinds of things in the future.

grencez commented 1 year ago

I rebuilt and can't reproduce the behavior. Strange...

If this happens again, I'd like to use a fixed seed to repro.