h2oai / h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
http://h2o.ai
Apache License 2.0
11.22k stars 1.23k forks source link

Consider search as in chat-ui #1136

Open iChristGit opened 9 months ago

iChristGit commented 9 months ago

I installed the latest One-click Installer (using windows11) I can see most features but the one I really interested in is the web search option like in the website https://gpt.h2o.ai/ image Running locally I dont see that option.

Nov 05, 2023:

h2oGPT GPU-CUDA Installer (1.9GB file)

Is that only available in the latest build from scratch option ? Or is there a way to enable it?

pseudotensor commented 9 months ago

It's part of windows install via this package:

https://github.com/h2oai/h2ogpt/blob/bede54b665b1c630a43ff09a918e3d17020dcac1/windows_installer.cfg#L99

One requires to do things mentioned here:

https://github.com/h2oai/h2ogpt/blob/9560e4401d18255a1ef370df6aa80f82fdc604c5/docs/README_SerpAPI.md

i.e. need API key. They give free searches up to some limit.

iChristGit commented 9 months ago

Can the feature work without api? I think it would benefit users to fetch the results locally. 🙏

pseudotensor commented 9 months ago

No way I'm aware of.

iChristGit commented 9 months ago

No way I'm aware of.

Ive been playing around with the huggingface chat-ui (https://github.com/huggingface/chat-ui) It also had only api option for search queries, but they added the option to fetch it locally without api recently, maybe you can look at how they implemented it?