Add tutorial on grammars

kaust-generative-ai / local-deployment-llama-cpp

Project to help you get started working with LLMs locally with LLaMA C++.

Apache License 2.0

1 stars 1 forks source link

Add tutorial on grammars #18

Open davidrpugh opened 1 month ago

davidrpugh commented 1 month ago

Grammars are super useful mechanism to constrain the output of your model for post processing. Grammars deserve a separate tutorial. Currently they are only mentioned in the performance tips and tricks section of the performance tuning notebook.