SillyTavern / SillyTavern

LLM Frontend for Power Users.
https://sillytavern.app
GNU Affero General Public License v3.0
8.03k stars 2.38k forks source link

[FEATURE_REQUEST] Quick Reply Slash-command for Tokenizer #2575

Closed rrosmarinuss closed 1 month ago

rrosmarinuss commented 3 months ago

Have you searched for similar requests?

Yes

Is your feature request related to a problem? If so, please describe.

N/A

Describe the solution you'd like

Implement a slash command for the Quick Replies extension to allow one to swap to a different tokenizer upon send. [Ex. /tokenizer Llama3]

Describe alternatives you've considered

'Best match' is the ideal solution for when swapping models/presets using Quick Replies, however, certain APIs do not support that setting and therefore require the user to change their tokenizer manually each time.

Additional context

Wolfsblvt on Discord recommended I make a feature request here about it.

Priority

Low (Nice-to-have)

Are you willing to test this on staging/unstable branch if this is implemented?

Yes

github-actions[bot] commented 3 months ago

This issue has been marked as a good first issue for first-time contributors to implement! This is a great way to support the project, while also improving your skills, you'll also be credited as a contributor once your PR is merged. If you're new to SillyTavern here are a collection of resources If you need any support at all, feel free to reach out via Discord.


I am a bot, and this is an automated message 🤖

Wolfsblvt commented 3 months ago

Agreed, makes sense. Someone can pick this up, adding the current tokenizers to a slash command, while still allowing to switch to and back to the "Best match" model.

Should supplement the usage of /api, /model and such.

Wolfsblvt commented 1 month ago

Is done and already included in the latest release.