NousResearch / Hermes-Function-Calling

MIT License
475 stars 74 forks source link

status/support for grammar sampling #22

Open devidw opened 2 months ago

devidw commented 2 months ago

hey

awesome work on hermes 2 pro

getting very good and reliable output for my tool definitions

wondering if this repo has support for grammar sampling?

i am currently using my own inference abstraction for the function calling prompt syntax and parsing and not this repo - and i did notice that in a small number of cases, it makes argument values up, that do not exist in my definition

which grammar sampling should fix

is it part of this repo? if not, planned to add it?

reference https://github.com/MeetKai/functionary/pull/74