search

assafelovic / gpt-researcher

GPT based autonomous agent that does online comprehensive research on any given topic
https://gptr.dev
MIT License
12.98k stars 1.61k forks source link

More flexible similarity distance handling #590

Closed barsuna closed 2 weeks ago

barsuna commented 2 weeks ago

I found that default similarity threshold in compression.py (0.38?) does not always work great. With some embedding models i had to lower it and there is no way to do it other than editing code.

Does it make sense to move this to the config?

Also when there are no hits within set similarity threshold, is it possible to print the nearest distance found (when verbose is on)?

assafelovic commented 2 weeks ago

Hey @barsuna done here: https://github.com/assafelovic/gpt-researcher/commit/7be4efd4ccfd146201ae336b8ea25854463d0e7e

Thanks for the feedback! Regarding verbose, would be over engineering in my opinion, but you can always debug and modify the code if needed. Thanks!