Open Alex-Songs opened 2 years ago
It is usually due to environment issues (e.g. improper CXX compiler, CUDA dependencies, or NCCL dependencies) which make Tutel installation only enable CPU support, e.g. python3 -m tutel.examples.helloworld --device cpu
.
The common way to enable GPU support correctly is to see carefully about the log during the setup of Tutel, find the dependency error information in the log and fix them up. If you are not quite familiar with certain errors, you can share the installation log here which would help us to diagnose.
Cannot import JIT optimized kernels. Did you forget to install Custom Kernel Extension?