huggingface / optimum-nvidia

Apache License 2.0
844 stars 83 forks source link

Failed to import optimum.nvidia #121

Open abpani opened 2 months ago

abpani commented 2 months ago

RuntimeError: Failed to import transformers.models.falcon.modeling_falcon lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: Kindly suggest.