issues
search
mlc-ai
/
binary-mlc-llm-libs
167
stars
43
forks
source link
[WASM] Update prebuilt wasms to version 0.2.39
#123
Closed
CharlieFRuan
closed
1 month ago
CharlieFRuan
commented
1 month ago
Compiled at:
MLC-LLM at
https://github.com/mlc-ai/mlc-llm/commit/dc091e7f55fda946c70891501e1f33ee54861ba6
TVM at
https://github.com/CharlieFRuan/tvm/tree/fix-0528-vectorize
Equivalent to main branch
https://github.com/apache/tvm/commit/b598f28a1cecabf95a1986dcc55a864c8c9ab743
Main changes include:
Grammar (i.e. json mode) support for Llama3
https://github.com/mlc-ai/mlc-llm/pull/2248
https://github.com/mlc-ai/mlc-llm/pull/2335
https://github.com/mlc-ai/mlc-llm/pull/2416
Post process of tokens done with MLC's runtime WASM
New models:
Phi3-mini-4k
Hermes-2-Pro-Llama-3-8B
Qwen1.5-1.8B
StableLM-2-zephyr_1.6B
Compiled at:
Main changes include: