[REQUEST] Implementation of DRY sampler (Don't Repeat Yourself)

[Abdulhanan535]

Problem

Majority of the bots repeat sentences and due to that, it's annoying.

Solution

Implementing DRY sampler for TabbyAPI

Alternatives

No response

Explanation

DRY is a sampler that forces the model to not repeat while mantaining the quality or even improving it, some of the backends have already support for this.

• Text Gen webui
• koboldai
• llamaccp

Examples

No response

Additional context

No response

Acknowledgements

• [X] I have looked for similar requests before submitting this one.
• [X] I understand that the developers have lives and my issue will be answered when possible.
• [X] I understand the developers of this program are human, and I will make my requests politely.

[bdashore3]

See issue https://github.com/turboderp/exllamav2/issues/447

If it's added in upstream, I can add it here.

[Abdulhanan535]

is it done?