dvolgyes
commented
2 years ago That is a very interesting problem. Could you provide the versions for setuptools / wheels, both before and after upgrading? Apt-get update pulls new packages, so when somebody will try to reproduce this later, this information might help. Also, you could maybe upgrade only one of them, maybe that would reduce the search space? (ie. upgrading setuptools breaks it, upgrading wheels breaks it, if both are upgraded, then it breaks).
I have absolutely no overview how onnxruntime works, but I would guess this relates to the method how onnxruntime looks up which accelerators are installed. Probably there was a change in setuptools (or wheels) and it breaks something. If this is the case, it would be nice to hunt it down, because sooner or later every project, distribution will move to newer packages, so the bug will affect more and more people.
trifle
snnn
Describe the bug This is a very weird but replicable bug. I'm building a docker image with onnxruntime (among other frameworks and libraries). When I run
pip3 install -U pip setuptools wheelas part of the build pipeline, it disables GPU acceleration in onnxnet.Urgency Not urgent, I avoid upgrading said python packages. But it's definitely an unexpected and potentially cumbersome bug to deal with and many people might run across it eventually if there's an upcoming incompatibility.
System information
To Reproduce Here is a replication Dockerfile. Note that you will need to swap the default docker runtime to
nvidia-container-runtimeto make GPUs and nvidia cuda libraries available during build. To do that, edit it in/etc/docker/daemon.json.When this Dockerfile is built (docker build -t onnx-test -f Dockerfile .), it will emit "CPU" showing that CUDA is not available to onnx. After commenting out the line that installs pip, setuptools and wheel, it will show "GPU".
Expected behavior I would expect upgrades to ubiquitous python packages such as pip, setuptools and wheels not to break onnx. And I would expect a more useful error.
Screenshots
Additional context