Closed CharlieFRuan closed 2 months ago
WebLLM's 0.2.34 model libraries are compiled with:
MLC-LLM at https://github.com/mlc-ai/mlc-llm/commit/a1830c166ea64d884886a079cca6e594f4604d56 TVM at https://github.com/apache/tvm/commit/57316dae1497c36ed57732a7a610018a990f1927
Main changes include support for json schema (from MLC runtime), and a new way of handling TVMArray in packed func (from TVM runtime).
WebLLM's 0.2.34 model libraries are compiled with:
MLC-LLM at https://github.com/mlc-ai/mlc-llm/commit/a1830c166ea64d884886a079cca6e594f4604d56 TVM at https://github.com/apache/tvm/commit/57316dae1497c36ed57732a7a610018a990f1927
Main changes include support for json schema (from MLC runtime), and a new way of handling TVMArray in packed func (from TVM runtime).