Run python chat.py -rag with appropriate docs in settings.json
Change the chunk size in settings to a different value
Run "refresh" command or exit and reload
This will correctly report that the chunk size has been switched to the value in manifest.json. This is important! Even though the value is not used, it is important for the user to know how the documents in the currently loaded vectorstore are chunked.
The error: settings.json doesn't update this in real time.
The fix: I'll use settings.json as my static default workflow. There will be a new file, active.json, that always hold correct values for the existing loaded DB. The data is modified as a side effect in RagSettings.adjust_rag_settings.
To replicate:
python chat.py -ragwith appropriate docs in settings.jsonThis will correctly report that the chunk size has been switched to the value in manifest.json. This is important! Even though the value is not used, it is important for the user to know how the documents in the currently loaded vectorstore are chunked.
The error: settings.json doesn't update this in real time.
The fix: I'll use settings.json as my static default workflow. There will be a new file, active.json, that always hold correct values for the existing loaded DB. The data is modified as a side effect in RagSettings.adjust_rag_settings.