containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
145 stars 23 forks source link

Provide infrastructure for starting a REST server #1295

Open jeffmaury opened 3 days ago

jeffmaury commented 3 days ago

Setttings should have an entry for the port number (default 10434 ?). If port is busy when starting the extension, allocate a random port and update the settings (so that external CLIs have a way to get the port number)