Open JohnGalt1717 opened 8 months ago
The best way to ensure that LLMs return structured data properly is using GBNF format. It would be great if NJsonSchema generated GBNF formats.
Here's some documentation on it and examples:
https://github.com/ggerganov/llama.cpp/tree/master/grammars https://github.com/IntrinsicLabsAI/gbnfgen
The best way to ensure that LLMs return structured data properly is using GBNF format. It would be great if NJsonSchema generated GBNF formats.
Here's some documentation on it and examples:
https://github.com/ggerganov/llama.cpp/tree/master/grammars https://github.com/IntrinsicLabsAI/gbnfgen