KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
https://koboldai.com
GNU Affero General Public License v3.0
3.46k stars 747 forks source link

Null Response #163

Closed Jay4242 closed 1 year ago

Jay4242 commented 1 year ago

Whenever I submit a prompt all I get back is,

WARNING    | __main__:actionsubmit:4176 - Unknown tokenizer ''
PROMPT     @ 2022-10-05 18:41:33 | This is a test
ERROR      | __main__:sendtocluster:5257 - {"text": null, "server_id": null, "server_name": null, "queue_position": null}

I'm in Linux running the https://github.com/henk717/koboldai version. I loaded the API key and loaded 'All.' Not sure what else to do.

Jay4242 commented 1 year ago

My mistake, I was using an API key for stablehorde not koboldai.