search

microsoft / tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation
MIT License
723 stars 93 forks source link

Cannot import JIT optimized kernels. Did you forget to install Custom Kernel Extension? #180

Open Alex-Songs opened 2 years ago

Alex-Songs commented 2 years ago

Cannot import JIT optimized kernels. Did you forget to install Custom Kernel Extension?

ghostplant commented 2 years ago

It is usually due to environment issues (e.g. improper CXX compiler, CUDA dependencies, or NCCL dependencies) which make Tutel installation only enable CPU support, e.g. python3 -m tutel.examples.helloworld --device cpu.

The common way to enable GPU support correctly is to see carefully about the log during the setup of Tutel, find the dependency error information in the log and fix them up. If you are not quite familiar with certain errors, you can share the installation log here which would help us to diagnose.