mlc notebook provided doesnt run on colab

OpenGVLab / OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

MIT License

663 stars 50 forks source link

mlc notebook provided doesnt run on colab #15

Closed githubpradeep closed 6 months ago

githubpradeep commented 11 months ago

error vocab_size not found

ChenMnZ commented 11 months ago

Which code produced this error?

githubpradeep commented 11 months ago

please run it on google colab you will see the error

ChenMnZ commented 11 months ago

Thanks for your feedback. I find that this bug is caused by mlc-llm. So runing_quantized_models_with_mlc_llm.ipynb can not be use until official mlc-llm fixing their bug. I will fix this after mlc-llm fix the bug of there repo.