Closed giladgd closed 7 months ago
:tada: This issue has been resolved in version 3.0.0-beta.2 :tada:
The release is available on:
v3.0.0-beta.2
Your semantic-release bot :package::rocket:
:tada: This issue has been resolved in version 3.0.0-beta.4 :tada:
The release is available on:
v3.0.0-beta.4
Your semantic-release bot :package::rocket:
Make it possible to provide functions that the model can call as part of the response.
It should be as simple as something like that:
If you have ideas of a text format I can use to prompt the model with, please share. I'm looking for a format that can achieve all of these:
I thought about implementing support for this format as part of
GeneralChatPromptWrapper
, but I'm not really sure whether this the safest way to distinguish between text and function calling:Then when the model will write text, it may go like that:
I'll then detect the function call in the model response and evaluate this text:
So the model can then continue to provide completion:
I'll then detect the function call in the model response and evaluate this text:
So the model can then continue to provide completion:
I plan to use grammar tricks to make sure the model can only call existing functions and with the right parameter types.
How you can help
LlamaChatPromptWrapper
) format, this would also be very helpfulI'm currently working on a major change in this module, so if you'd like to help with implementing any of this, please let me know beforehand so your work won't become incompatible with the new changes