search

mamei16 / LLM_Web_search

An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo
GNU Affero General Public License v3.0
146 stars 23 forks source link

Sparse Lexical and Expansion model (SPLADE) keyword retriever #34

Closed mamei16 closed 2 months ago

mamei16 commented 2 months ago

This PR contains the following changes:

  1. Add optional new keyword based retriever SPLADE
  2. Switch from threaded requests to asynchronous aiohttp for slightly faster webpage download speeds
  3. Change cache folder of the Huggingface models downloaded via this extension, so that they are now saved in the extension's folder.