search

PromtEngineer / localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
Apache License 2.0
19.64k stars 2.2k forks source link

RunLocalGPT-> RecursionError: maximum recursion depth exceeded while getting the str of an object #127

Open weasel4o opened 1 year ago

weasel4o commented 1 year ago

Windows 10 RTX3070 Cuda enabled and compiled using pytorch (100 lines of this) return str(self._unk_token) ^^^^^^^^^^^^^^^^^^^^

================Ends with:====================

RecursionError: maximum recursion depth exceeded while getting the str of an object 2023-06-10 17:32:35,211 - INFO - duckdb.py:414 - Persisting DB to disk, putting it in the save folder: E:\GPT\localGPTCUDA

LeafmanZ commented 1 year ago

What model is selected in your run_localGPT.py? If the following was seletected model_id = "TheBloke/vicuna-7B-1.1-HF" change it to one of the following for now: model_id = "TheBloke/Wizard-Vicuna-7B-Uncensored-HF" model_id = "TheBloke/guanaco-7B-HF"

starkizard commented 1 year ago

For me , reinstalling the requirements worked. see if you're in the correct virtual env too