containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
168 stars 30 forks source link

User should be able to turn off/on the web server in the configurations #1596

Open axel7083 opened 2 weeks ago

axel7083 commented 2 weeks ago

Is your enhancement related to a problem? Please describe

Since https://github.com/containers/podman-desktop-extension-ai-lab/pull/1544 we by default start a REST server when AI Lab is started

Describe the solution you'd like

Having an option to disable it in the configuration. And IMO have it disabled by default.

Describe alternatives you've considered

No response

Additional context

cc @feloy @benoitf @jeffmaury

benoitf commented 2 weeks ago

it should also require also some authentication else we'll start to receive some CVE

axel7083 commented 2 weeks ago

it should also require also some authentication else we'll start to receive some CVE

What do you mean, you would like us to generate some token that people will have to include in their authorization request ?

jeffmaury commented 2 weeks ago

It should be enabled by default. Authentication is an issue as we want to be ollama compatible so maybe we should more restrictive about network addresses

benoitf commented 2 weeks ago

it should also require also some authentication else we'll start to receive some CVE

What do you mean, you would like us to generate some token that people will have to include in their authorization request >?

everytime that there is a server listening without an authentication, then people will do for example a request in a webpage calling something to the server to do things on behalf of the user (but without its agreement) so at the end, I saw security requests