Allow the model/api to be changed for the task generation/checking

SillyTavern / Extension-Objective

Set an Objective for the AI to aim for during the chat.

GNU Affero General Public License v3.0

7 stars 10 forks source link

Allow the model/api to be changed for the task generation/checking #4

Open jcredland opened 2 months ago

jcredland commented 2 months ago

Some models handle the task generation and checking much more effectively than others. It would be useful to be able to switch API connections (or models with open router) to pick one specifically for the objectives API prompts.

Cohee1207 commented 2 months ago

This is not as simple as it sounds. See:

https://github.com/SillyTavern/SillyTavern/issues/962
https://github.com/SillyTavern/SillyTavern/issues/2538
https://github.com/SillyTavern/SillyTavern/issues/2658
https://github.com/SillyTavern/SillyTavern/issues/2822

jcredland commented 2 months ago

Oh well that's a bigger rabbit hole than I was imagining ...

I was kind of hoping I could patch it with one line to change the OpenRouter model even if it wasn't a fix that'd work for everyone ;-)