Open rentainhe opened 4 days ago
The environment settings are incorrectly installed if the inference speed exceeds 5 seconds. Check the installation docs below.
If the environment settings are correctly installed, there will be no red-colored error: error: libsublasLt.so.11: cannot open shared object file: No such file or directory
(you may see only the yellow warning messages).
To enable GPU acceleration, please install the compatible onnxruntime-gpu package based on your environment settings (CUDA and CuDNN versions), following the instructions in the onnxruntime installation docs.
Hi authors, when running the ZiM-L model, we met such a problem here:
And the inference speed is very slow, is there any solution about this issue.