Issue with Chromabd and vectorization.

[Theking1313]

I tried using the chromadb feature and it seems to have installed correctly but it does not work, even when I press the Vectorize All button. I'm using default settings but am using gpu for extras.

Vectorization failed Check server console for more details

Streaming request finished
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)

[Cohee1207]

Delete the vectors folder for your chat in the ST directory and regenerate them in the plugin settings.

[Theking1313]

Thanks that worked.

I deleted the Vector folder and how see the processed number go up.

I will now how to test using the database and see it in action on a new chat.

[Technologicat]

Note that the Smart Context extension has now been superseded by the built-in Vector Storage extension.

Upgrading is recommended, as the old Smart Context extension is no longer developed.

Vector Storage does not need ChromaDB.

To upgrade:

• Make sure both your SillyTavern and your ST-extras are up to date.
• Configure your ST-extras server to load the embeddings module.
  • Optionally, you can choose a custom text embedding model just as before, using the --embedding-model command-line argument of the ST-extras server.
  • The embeddings module uses the device (CPU or GPU) that you have configured your ST-extras to use. As usual, see the --cpu (CPU, default), --cuda (GPU) and --cuda-device command-line arguments.
  • The chromadb module in ST-extras, and the chromadb Python library, are no longer needed.
• Restart your ST-extras server.
• Restart SillyTavern, just to be safe.
• In the ST GUI: Extensions ⊳ Vector Storage ⊳ Vectorization Source: choose Extras
• Done! You should now have Vector Storage working with the fast Extras provider.