Vali-98
commented
3 weeks ago The issue with Samplers is that they change per backend and some are really complex to explain. It's difficult to convey how a sampler works, especially if the user has no fundamentals on how LLMs work.
I would just refer to existing guides such as: https://github.com/LostRuins/koboldcpp/wiki#what-are-samplers-how-do-i-change-or-disable-them-what-are-the-best-samplers
For now, I don't think I will be supporting this in-app.
I think providing some information about samplers would be more beginner-friendly. Thanks for your effort. 👍