Open Karthik1611 opened 1 year ago
I believe you still have the model parameter set to Llama instead of falcon in your configuration file. I recognize this error and I believe I fixed it in that way!
This looks related to https://github.com/marella/ctransformers/issues/58#issuecomment-1656702193 I'm guessing AWS Sagemaker notebook instance is using Amazon Linux 2 which uses old glibc version. You can try building it from source:
pip uninstall ctransformers --yes # uninstall if already installed
pip install ctransformers --no-binary ctransformers
If you need GPU support install using:
CT_CUBLAS=1 pip install ctransformers --no-binary ctransformers
Hi
I am trying to use ctransformers to load the falcon-40b ggml model and I get the following error
OSError: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /home/ec2-user/anaconda3/envs/amazonei_pytorch_latest_p37/lib/python3.7/site-packages/ctransformers/lib/avx2/libctransformers.so)
I am using an AWS Sagemaker notebook. I am new to this, please help in resolving this issue