search

marella / chatdocs

Chat with your documents offline using AI.
MIT License
683 stars 97 forks source link

Google colab: OSError: libcudart.so.12: cannot open shared object file: No such file or directory #87

Closed buivangiang-12148701 closed 10 months ago

buivangiang-12148701 commented 10 months ago

When I configure the chatdocs.yml file and run the command !chatdocs download on Google Colab, it completes downloading the model file and reports the following error: "OSError: libcudart.so.12: cannot open shared object file: No such file or directory"

chatdocs.yml

ctransformers: model: TheBloke/Llama-2-7B-GGUF model_file: llama-2-7b.Q40.gguf model_type: llama config: gpu_layers: 50