RandomInternetPreson / LucidWebSearch

A web search extension for Oobabooga's text-generation-webui (now with nougat)
GNU Affero General Public License v3.0
61 stars 6 forks source link

It works but it adds blubberish text in the output #6

Open heathcliff2019 opened 5 months ago

heathcliff2019 commented 5 months ago

image

For people who wants to autolaunch the browser add the following code in the start_windows.bat:

@rem Launch Chrome in incognito mode with remote debugging enabled
start "" "C:\Program Files\Google\Chrome\Application\chrome.exe" --remote-debugging-port=9222 --incognito

Just below the:

@rem check if conda environment was actually created
if not exist "%INSTALL_ENV_DIR%\python.exe" ( echo. && echo Conda environment is empty. && goto end )
RandomInternetPreson commented 5 months ago

Thanks for the suggestion about auto launching the browser. I need to implement something like that <3

Hmm, regarding your output, have you tried any of the following:

  1. a different website (if there is a lot of text on your website it may throw off the model)
  2. a different model
  3. different model parameters
  4. changing the number of characters that get sent to the model (the default is 6000)

I recall seeing a similar issue when I was developing the extension, if I recall correctly, the model was just a bad model and it would output gibberish; I could be recalling incorrectly and it was the model parameters that were throwing things off. The first thing to mess with is temperature, try bringing that down.