search

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.79k stars 135 forks source link

OSError: /lib64/libm.so.6: version `GLIBC_2.29' not found #41

Open Karthik1611 opened 1 year ago

Karthik1611 commented 1 year ago

Hi

I am trying to use ctransformers to load the falcon-40b ggml model and I get the following error

OSError: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /home/ec2-user/anaconda3/envs/amazonei_pytorch_latest_p37/lib/python3.7/site-packages/ctransformers/lib/avx2/libctransformers.so)

I am using an AWS Sagemaker notebook. I am new to this, please help in resolving this issue

Ananderz commented 1 year ago

I believe you still have the model parameter set to Llama instead of falcon in your configuration file. I recognize this error and I believe I fixed it in that way!

marella commented 1 year ago

This looks related to https://github.com/marella/ctransformers/issues/58#issuecomment-1656702193 I'm guessing AWS Sagemaker notebook instance is using Amazon Linux 2 which uses old glibc version. You can try building it from source:

pip uninstall ctransformers --yes # uninstall if already installed
pip install ctransformers --no-binary ctransformers

If you need GPU support install using:

CT_CUBLAS=1 pip install ctransformers --no-binary ctransformers