Open pnknguyen27 opened 9 months ago
do you know how to fix this problem, thank you.
Did you download the chatbot model as explained in the wiki page here ? The current setup of chatbots is currently being completely changed but if you want to use it now, just follow the instructions on the link.
i had downloaded Pygmalion like the wiki page and put the folder created in chatbot_models in the Monik.A.I folder yet., even setuptext-generation-webui.
The new setup isn't ready yet with text-generation-webui. However, if you put the whole folder for the Pygmalion model in chatbot_models
, it should work with the current version.
how about the cudNN, i have downloaded it but not install yet. Does it affect on process? thank you.
i think i must try another model like RWKV.
The setup of CUDA is indeed important if you're trying to use local chatbots but it is not related to the previous error which was about a missing file from the chatbot.
after use RWKV model, look like error like you said above, relate to CUDA
Okay then continue to follow the previous link about the installation of CUDA and don't forget to run setup_gpu.bat
in last before running it again.
it's still this error although i have install like the tutorial
and i have check the cuda
As I said before, the setup with text-generation-webui
is not ready and even more not with RWKV which is using a different pipeline of generation. Please refer only and only to the link I've linked before, downloading the model and running setup_gpu.bat
.