mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.23k stars 1.58k forks source link

[Grammar] Migrate to XGrammar #3015

Closed Ubospica closed 1 week ago

Ubospica commented 1 week ago

This PR migrates the implementation of the grammar engine to an outside library XGrammar. The implementation of XGrammar is basically the same as our current version, but more modularized and robost. XGrammar will be continuously enhanced in the future.

See https://github.com/mlc-ai/xgrammar for more details.

cc @tqchen @MasterJH5574 @cyx-6 @CharlieFRuan