Lots of good changes going to bring them in slowly!
To empower the user more in prompting I need to make the system "Tool" friendly. So that no matter the LLM it can see the toolas available and choose the one or more tools needed to forfill the prompt.
For example I send links to my Assistant Email box that I want to read later.
Get the content from the links included in the email. Then format the content like this
Summary: TLDR
Title:
Content:
Make an image to go with the article
And then on Friday make sure to remind me to read all the articles that came in
So it would find the tools like "get_content_from_link", "make_image", "create_reminder"
This will work for Ollama, Claude, OpenAi, Groq all the same.
TODO
[x] Ollama
[x] Claude
[ ] OpenAi
[ ] Groq
[x] Clean up all the other methods that need this new way of running tools
[ ] Add it as a feature flag merge into main and run it on for a bit on my server
alnutile
commented
2 months ago
Lots of good changes going to bring them in slowly!
To empower the user more in prompting I need to make the system "Tool" friendly. So that no matter the LLM it can see the toolas available and choose the one or more tools needed to forfill the prompt.
For example I send links to my Assistant Email box that I want to read later.
So it would find the tools like "get_content_from_link", "make_image", "create_reminder"
This will work for Ollama, Claude, OpenAi, Groq all the same.
TODO