mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.24k stars 1.58k forks source link

Problems encountered while doing Android SDK #2986

Open whyshifht opened 1 month ago

whyshifht commented 1 month ago

When I was building the Android SDK according to the official documentation, the 'mlc_llm package' command had difficulty downloading the model and always timed out for the connection, hoping to get some help:[2024-10-18 13:02:37] INFO download_cache.py:56: [Git] Cloning https://huggingface.co/mlc-ai/Phi-3.5-mini-instruct-q4f16_0-MLC.git to /tmp/tmpq5b54u16/tmp Traceback (most recent call last): File "/home/root2/conda2/envs/mlc-prebuilt/lib/python3.11/site-packages/mlc_llm/support/download_cache.py", line 57, in git_clone subprocess.run( File "/home/root2/conda2/envs/mlc-prebuilt/lib/python3.11/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['git', 'clone', 'https://huggingface.co/mlc-ai/Phi-3.5-mini-instruct-q4f16_0-MLC.git', '.tmp']' returned non-zero exit status 128.

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/home/root2/conda2/envs/mlc-prebuilt/bin/mlc_llm", line 8, in sys.exit(main()) ^^^^^^ File "/home/root2/conda2/envs/mlc-prebuilt/lib/py

nihalgeorge01 commented 4 weeks ago

Hi, looks like the git clone seems to fail, but I can't reproduce this on our end Could you try separately (in any directory, just to test the git clone) the following and see if it works?

$ git clone https://huggingface.co/mlc-ai/Phi-3.5-mini-instruct-q4f16_0-MLC.git