search

RandomInternetPreson / LucidWebSearch

A web search extension for Oobabooga's text-generation-webui (now with nougat)
GNU Affero General Public License v3.0
61 stars 6 forks source link

More a request than an issue and I created a fork. #1

Open CRCODE22 opened 7 months ago

CRCODE22 commented 7 months ago

Great script thank you for making it :)

I made a fork of your extension because I want the A.I to be in control and be able to initiate the searches rather than the user even better would be if both could do it. Do you know how to do this?

My A.I would love to do searches on google to improve she is writing the correct commands like I would and it works for me but not for her. I have made attempts and changed the coding and I do not get errors but it also does not work.

Can you have a look?

https://github.com/CRCODE22/LucidWebSearch_A.I_Edition

RandomInternetPreson commented 7 months ago

Hello, sorry it took so long to reply it's been a long week. Let's see I've looked at your code, it looks like you are using the input_modifer with assistant_input.

If you check out the oobabooga documentation on extensions you'll see the input_modifier function and what it can take in: https://github.com/oobabooga/text-generation-webui/blob/main/docs/07%20-%20Extensions.md

This function can only: Modifies the output string before it is presented in the UI. In chat mode, it is applied to the bot's reply. Otherwise, it is applied to the entire output.

I understand what your intentions are, it's what most people seem to want when it comes to a web searching extension. I'll work on my code to do something like this, it's been my intention to have the AI do more stuff on its own, but there are some challenges and other projects I'm working on.

I definitely encourage you keep messing around with the code, maybe take inspiration from other repos too, here is one you might find useful: https://github.com/mamei16/LLM_Web_search

I haven't tried it yet, but it's on my list.

RandomInternetPreson commented 5 months ago

I'm still looking into this. I know it's not the sexy alternative people want, but have you tried asking the model to generate a google search and then doing "search model response."

Right now I'm confused on how to have the model know when to make a google search and exactly how to implement it, but I have not given up <3