search

acheong08 / ChatGPT

Reverse engineered ChatGPT API
GNU General Public License v2.0
28k stars 4.48k forks source link

fix for crashes in tiktoken due to message being empty and not being … #1458

Closed MrMatch246 closed 1 year ago

MrMatch246 commented 1 year ago

…handled down the line.

  File "/home/user/REPOS/rAIversing/venv3/lib/python3.11/site-packages/revChatGPT/V3.py", line 390, in ask
    full_response: str = "".join(response)
                         ^^^^^^^^^^^^^^^^^
  File "/home/user/REPOS/rAIversing/venv3/lib/python3.11/site-packages/revChatGPT/V3.py", line 197, in ask_stream
    self.__truncate_conversation(convo_id=convo_id)
  File "/home/user/REPOS/rAIversing/venv3/lib/python3.11/site-packages/revChatGPT/V3.py", line 143, in __truncate_conversation
    self.get_token_count(convo_id) > self.truncate_limit
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/REPOS/rAIversing/venv3/lib/python3.11/site-packages/revChatGPT/V3.py", line 169, in get_token_count
    num_tokens += len(encoding.encode(value))
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/REPOS/rAIversing/venv3/lib/python3.11/site-packages/tiktoken/core.py", line 116, in encode
    if match := _special_token_regex(disallowed_special).search(text):
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: expected string or buffer
acheong08 commented 1 year ago

Something went wrong when merging

acheong08 commented 1 year ago

merged