web search doesn't search in reference I pass

[rrfaria]

web search doesn't search in reference I pass

I was hoping chat do RAG behind web search but it's not searching in reference I passed.

I used this prompt to test direct on hugging face chat

I didn't look at how web search works in deep, but I would like to suggest an approach: using IA to generate search prompts to send to serpapi and in case of a specefic reference, download content directly on provided url to do RAG

Another problem I noticed is websearch sometimes doesn't look at recent events on search, especially on prompts that requires date. You can test this by ask about financial events, it mixes articles from 2020, 2018 or any article searchs returned related to topic. For instance, If I ask on chat what will be dividend payed in november 2023, it probably will return data related to other years, since they contains novembers on text.

use fallowing site as reference and tell me how itausa will perform on 3t23
https://www.infomoney.com.br/mercados/santander-sanb11-itau-itub4-bb-bbas3-e-bradesco-bbdc4-como-os-bancoes-devem-se-sair-na-temporada-resultados-3t23/

source websearch returned: mckinsey.com deloitte.com

[nsarrazin]

Hi! thanks for the comment. I see two possible ways to improve the websearch here:

• if a URL is passed in the prompt, always add it to the websearch links that will be parsed. (maybe even only use the URLs defined in the message if there are some)
• We could improve our few-shot prompting for the websearch to add examples where the user asks for a specific site like "only use wikipedia for your answer" and the model will add site:wikipedia.org to the query

What do you think @mishig25 ?

[julien-blanchon]

I'm just curious :eyes:, did someone work on including RAG search in HuggingChat ?