containers / ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman
Apache License 2.0
70 stars 75 forks source link

Add a recipe that works with function calling models #562

Open lstocchi opened 3 weeks ago

lstocchi commented 3 weeks ago

In podman desktop ai lab we are planning to add function calling models support -> https://github.com/containers/podman-desktop-extension-ai-lab/issues/1116

We would need a recipe + a list of recommended models to work with

axel7083 commented 2 weeks ago

Depends on https://github.com/containers/ai-lab-recipes/issues/601

rhatdan commented 1 week ago

601 merged, can we close this?

lstocchi commented 1 week ago

@rhatdan no. This issue is related to the need to have something similar to the chatbot/rag recipe. So we can add it to ai-lab extension. The user downloads the recipe, play with it, check the code how to rewrite a similar app ....