BoundaryML / baml

BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promptfiddle.com playground
https://docs.boundaryml.com
Apache License 2.0
1.09k stars 34 forks source link

jsonish: more capable scoring in union discriminant selection #949

Open sxlijin opened 3 weeks ago

sxlijin commented 3 weeks ago

Coming from #934; tldr- because scoring for union discriminant selection switches solely on which candidate was least penalized, we can't use "quantity of information preserved" as a metric. Flags is obviously too complex to use as a scoring metric, we do need a scoring metric that is closed under recursive summation, but I suspect we'll run into more awkward situations along these lines.

links: