Open psfoley opened 1 month ago
@hwpang, thanks for raising this issue!
It is a strange one. To my understanding, it seems to be caused when triton
imports setuptools
. More specifically, it is because setuptools
is being imported after distutils
(I'd have to follow the stack trace deeper to see where this is occuring, though). setuptools
attempts to override distutils
with a local copy. If distutils
is imported beforehand, though, this can result in a conflict like the one we are seeing.
We'll do a deeper investigation to see to what extent we can resolve this on our end.
For now, there are two quick fixes you can do:
Option 1.
Down grade to torch==2.3.1
and torchvision==0.18.1
this will automatically install an earlier version of triton
that doesn't seem to have this issue. The workspace should automatically do this, so if you uninstall torch and torchvision, you should be able to just rerun:
fx workspace create --template torch_cnn_mnist --prefix my_workspace
-or-
Option 2.
Trying setting export SETUPTOOLS_USE_DISTUTILS=stdlib
if you need the latest torch
/triton
. This will disable using the local distutils
. This worked on my end. Hopefully on yours too
Discussed in https://github.com/securefederatedai/openfl/discussions/1016