search

henk717 / KoboldAI

KoboldAI is generative AI software optimized for fictional use, but capable of much more!
http://koboldai.com
GNU Affero General Public License v3.0
368 stars 130 forks source link

Add epsilon and eta sampling #475

Closed StefanGliga closed 11 months ago

StefanGliga commented 1 year ago

I have implemented epsilon and eta sampling from https://arxiv.org/abs/2210.15191 . In the UI I opted to expose it in units of 1e-4, to be similar to ooba. Tested both pytorch/gpu and TPU(jax_static specifically) and everything seems to work fine.

AlpinDale commented 1 year ago

@henk717 this looks good to me, have you tested yet for a merge?

henk717 commented 1 year ago

Have not been able to review it yet (See discord for details), its the first one on my list once I am able to review.

henk717 commented 11 months ago

Can't reproduce the issue I had with it anymore, so ill merge it and hopefully we don't break userspace.