mlc-ai / llm-perf-bench

Apache License 2.0
109 stars 12 forks source link

[BUG] mlc-llm benchmark failed with ROCm #36

Open alexhegit opened 7 months ago

alexhegit commented 7 months ago

I follow the steps by steps for rocm-benchmark. The last step run failed. The log is bellow.

$python -m mlc_chat.cli.benchmark --model ${PATH_TEST}/params --device "rocm:0" --prompt "What is the meaning of life?" --generate-length 256

The key words of error log is "[2024-01-17 08:53:37] ERROR model_metadata.py:93: FAILED to read metadata section in legacy model lib."

mlc-llm-rocm-bm-failed