search

eth-sri / lmql

A language for constraint-guided and efficient LLM programming.
https://lmql.ai
Apache License 2.0
3.48k stars 191 forks source link

[Question] Whats is the default decoder used in queries ? #347

Closed 4mbroise closed 2 months ago

4mbroise commented 2 months ago

Whats is the default decoder used in queries ?

I would say it's the argmax one but i can't find an answer in the documentation

lbeurerkellner commented 2 months ago

Yes, it's argmax.