Llama3 tooluse - Githubissues

smallcloudai / refact-lsp

LSP server for Refact, suitable for Sublime Text, and other editors

BSD 3-Clause "New" or "Revised" License

18 stars 10 forks source link

Llama3 tooluse #198

Open mitya52 opened 1 month ago

mitya52 commented 1 month ago

streaming and no-streaming tool usage for /v1/completions chat models
tested with llama3/8b/instruct
code does not depend on inference backend