search

KoboldAI / KoboldAI-Client

https://koboldai.com
GNU Affero General Public License v3.0
3.45k stars 743 forks source link

How to set an API secret ? #417

Open priamai opened 8 months ago

priamai commented 8 months ago

Hi there, I am hosting the client on Vast.AI and I would like to protect the API via a simple key. How can I do that? Cheers.

henk717 commented 8 months ago

The API doesn't support a key but the --remote link is already randomized and long.

priamai commented 8 months ago

The problem is that even with that when it is hosted on a VM with a static IP, eventually a user can figure it out via scanning and the abuse my service. I am just thinking of another way maybe have it listen only to localhost and then I can use ngrok + authentication token ?

henk717 commented 8 months ago

On the United version we don't allow direct IP access by default when only --remote is used, so they can't IP scan it.