search

mlc-ai / llm-perf-bench

Apache License 2.0
109 stars 12 forks source link

Update Dockerfile.cu121.mlc #28

Closed yongjer closed 11 months ago

yongjer commented 11 months ago

avoid error: unable to build: _pickle.UnpicklingError: invalid load key, 'v' image

junrushao commented 11 months ago

Hi @yongjer, thanks for raising this PR! Please note that in the latest instructions, we do not recommend build quantizing inside a docker container, and thus there won't be such an issue in the scope that this repo would want to cover; On the other hand, completely understand that missing "git lfs" will lead to this cryptic error message from PyTorch when using "--hf-path" in command line, and it definitely helps other users in the future! Therefore, I'm happy to get this particular PR in. Thanks again for sharing your findings!!