sigoden / llm-functions

Easily create LLM tools and agents using Bash/JavaScript/Python, also a library of commonly used LLM tools and agents.
MIT License
166 stars 22 forks source link

Doesnt work #105

Closed amartus-steel closed 3 weeks ago

amartus-steel commented 3 weeks ago

In current aichat 0.22 release - just following instructions doesnt work. It just prints

%functions%> search web for an actual temperature notations
[TOOL_CALLS] [{"name": "web_search", "arguments": {"query": "actual temperature notation"}}]

%functions%> list files
[TOOL_CALLS] [{"name":"list_files","function":[{"name":"fs_ls","arguments":aution"}}]

%functions%> create a file hello.txt with lorem ipsum contents
[TOOL_CALLS][{"name": "fs_write", "arguments": {"path": "hello.txt", "contents": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Fusce euismod commodo nisi, quis consequat libero. Integer eget velit Eget enim."}}]

%functions%> 

for any configured tool - no error, no result - nothing.

Please update the manual on how to setup it.

sigoden commented 3 weeks ago

It seems your model does not support stream function calling.

Add --no-stream/-S CLI option or Run .set stream false REPL command to switch to non-stream mode.