Dan-wanna-M / formatron

Formatron empowers everyone to control the format of language models' output with minimal overhead.
MIT License
121 stars 3 forks source link

Make interfaces more robust against untrusted input/misuse #13

Open Dan-wanna-M opened 2 weeks ago

Dan-wanna-M commented 2 weeks ago

Compiling schemas into kbnf engine is a very nontrivial process and unfortunately it is theoretically impossible to have a truly robust algorithm(in the sense of no accidental quadratic or even nonpolynomial complexity), but we can (and should) add some docs/warnings/assertions to ensure users' server wont accidentally use 77GB RAM(+VRAM) and killed by OS.