search

utilityai / llama-cpp-rs

150 stars 46 forks source link

example to use JSON outputs? #540

Open louis030195 opened 5 days ago

louis030195 commented 5 days ago

hi, trying to find out how to use JSON outputs, any example appreciated, digging into the code in the meantime!

MarcusDunn commented 4 days ago

unsure how the upstream llama-cpp repo has moved since I wrote it. But the grammer code is how I've created json in the past