Closed felixboettger closed 2 months ago
Could you try to install llm-benchmark with the following command on your Debian Linux?
pip install llm-benchmark==0.3.15
And see if this resolves your issues? Thank you.
Can confirm the issue is fixed in 0.3.15!
In the systeminfo module, lsb_release may be called as a subprocess. The lsb_release command is part of the lsb-core package, which is not installed by default on some distributions. This causes the benchmark to fail with TypeError: 'NoneType' object is not subscriptable.
Consider adding a try-catch block: