search

SillyTavern / SillyTavern-Extras

Extensions API for SillyTavern.
GNU Affero General Public License v3.0
549 stars 124 forks source link

Vector Storage error and ST crash #193

Closed madrooky closed 9 months ago

madrooky commented 10 months ago

So I made a complete fresh install of ST and the extras and I am not able to get Vector Storage to run. I must also say that I am a bit lost as to whether I might have installed something not correctly as there is no description for Vector Storage to install anything separately. I followed the documentation as best as I could.

So, the extras server is starting up, only with chromadb module enabled. grafik

But once I enable it in ST, i get this error and ST crashes: grafik

I restarted everything and checked for updates. I reinstalled chromadb manually, if that is even necessary, I don't know... I found another, kind of similar issue here and followed the recommendations and deleted the almost empty Vector folder from my ST folder and such things... I manually cloned the all-mpnet-base-v2 repo to make sure, as there were only 3 files in the older and I am not sure if something was missing. grafik

No idea what else I can do....

gfl1000 commented 9 months ago

Have you solved this problem? I've encountered the same issue.

Cohee1207 commented 9 months ago

You can try downloading the embedding model manually and putting it to /cache/Xenova/all-mpnet-base-v2 https://huggingface.co/Xenova/all-mpnet-base-v2/tree/main

madrooky commented 9 months ago

You can try downloading the embedding model manually and putting it to /cache/Xenova/all-mpnet-base-v2 https://huggingface.co/Xenova/all-mpnet-base-v2/tree/main

See the third screenshot, that's what I did. I cloned the repo to be exact and copied the files into the folder manually. Is something missing?

gfl1000 commented 9 months ago

You can try downloading the embedding model manually and putting it to /cache/Xenova/all-mpnet-base-v2 https://huggingface.co/Xenova/all-mpnet-base-v2/tree/main

Following this method, Vector Storage is now functioning properly.

Cohee1207 commented 9 months ago

@madrooky Your screenshot is very cropped, I can't confirm that the files went exactly where intended

madrooky commented 9 months ago

@madrooky Your screenshot is very cropped, I can't confirm that the files went exactly where intended

\SillyTavern\cache\Xenova\all-mpnet-base-v2 This is he path the files on the screenshot are located. I have downloaded everything manually again and I get the same result.

This is the result when selecting a character card in ST with VS active. grafik

Cohee1207 commented 9 months ago

Ensure you're running Node x64, not the 32-bit version. And make sure your host system has enough memory. Reinstall node and clear node_modules with npm cache and allow them to fetch using an appropriate bitness.

madrooky commented 9 months ago

Ensure you're running Node x64, not the 32-bit version. And make sure your host system has enough memory. Reinstall node and clear node_modules with npm cache and allow them to fetch using an appropriate bitness.

Dang, it was node... x86 Just threw the x64 over it and is working now thanks.