HazyResearch / safari

Convolutions for Sequence Modeling
Apache License 2.0
848 stars 70 forks source link

Potential reasons for stuck building wheel for droput-layer-norm #17

Closed radarFudan closed 1 year ago

radarFudan commented 1 year ago

Hi! It's a really nice repo and the code is quite clear to read.

As I was trying to run the hyena code for language model, it seems the building for third layer_norm package is stuck and I've waited for the third install a whole day.

cd ./csrc/fused_dense_lib && pip install .
cd ../xentropy && pip install .
cd ../layer_norm && pip install .

I just wonder if it's normal for a build to take so long or some bug with my configuration.

Basically the current output for (stuck terminal) is:

Building wheels for collected packages: dropout-layer-norm
  Building wheel for dropout-layer-norm (setup.p) ... |

Thank you so much for reading my issue!

radarFudan commented 1 year ago

Just found this issue has been proposed in flash-attention repo(https://github.com/HazyResearch/flash-attention/issues/131)