Open iamlixiao opened 3 weeks ago
I have the exact same issue attempting to follow the same guide, with the ROCm 6.2 version, on native Ubuntu 24.04, Python 3.11, both in Conda and with a virtual environment.
I observe the same issue. Android instructions when using ROCM 6.2 fails when calling mlc_llm package
🐛 Bug
I have been following the Android tutorial in official docs: https://llm.mlc.ai/docs/deploy/android.html
When performing Step 2. Build Runtime and Model Libraries,
mlc_llm package
command failed with the following output:RuntimeError: Cannot find compilation output, compilation failed
I then ran the same compilation command in gdb, and found that the failure was caused by a segmentation fault in libtvm:
To Reproduce
Steps to reproduce the behavior:
1.Follow the android tutorial, install dependencies, set environment variables, etc.. 2.run
mlc_llm package
Expected behavior
Model compiles, and the
./dist/
directory contain outputs as the tutorial states.Environment
conda
, source):python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-nightly-rocm61 mlc-ai-nightly-rocm61
pip
, source): Cloned with mlc-llm git sourcepython -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))"
, applicable if you compile models):