API/CLI for ai-lab - Githubissues

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers

https://podman-desktop.io/extensions/ai-lab

Apache License 2.0

151 stars 23 forks source link

API/CLI for ai-lab #822

Open slemeur opened 3 months ago

slemeur commented 3 months ago

It would be nice to have api to interact with ai-lab, so other tools can connect to ai-lab and pull, start models from APIs. Having a CLI wrapper around those apis would also be nice.

[ ] #1295
[ ] #1296

slemeur commented 3 months ago

Example use case:

Enable AI Lab to be a provider for continue (https://continue.dev/docs/model-setup/select-provider)
Quarkus Integration

MichaelClifford commented 3 months ago

@slemeur We've already started to document how to use our images for Continue https://github.com/containers/ai-lab-recipes/blob/main/recipes/natural_language_processing/code_generation/llms-vscode-integration.md

But a tighter integration with AI Lab would be nice.

slemeur commented 1 month ago

Initial step should be to provide compatibility to enable compatibility with the following APIs: https://github.com/ollama/ollama/blob/main/docs/api.md