search

KoboldAI / KoboldAI-Client

https://koboldai.com
GNU Affero General Public License v3.0
3.45k stars 743 forks source link

softprompt tuner not working #414

Open torakoneko opened 9 months ago

torakoneko commented 9 months ago

the softprompt tuner linked at https://github.com/KoboldAI/KoboldAI-Client/wiki/Soft-Prompts#creating-your-own is not working (i am able to connect to a TPU), is there an alternative or a fix?

i'm getting this error, it seems to be cloning this but seemingly not installing for some reason: ModuleNotFoundError: No module named 'mtj_softtuner'

henk717 commented 9 months ago

The TPU softtuner is abandonware and no longer supported. We eventually want to fix the GPU softtuner we were building, right now you could use MKUltra to tune a softprompt and then convert it to KoboldAI using an old converter but there are no instructions on this.

torakoneko commented 9 months ago

The TPU softtuner is abandonware and no longer supported. We eventually want to fix the GPU softtuner we were building, right now you could use MKUltra to tune a softprompt and then convert it to KoboldAI using an old converter but there are no instructions on this.

do you have a link for that converter?