michaelthwan / searchGPT

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

MIT License

621 stars 65 forks source link

Closed michaelthwan closed 1 year ago

michaelthwan commented 1 year ago

michaelthwan commented 1 year ago

PR: #34

supported faiss (merged).

refactored SemanticSearchService / Factory
support FAISS (with some parameter)
Didn't test whether it is better than pyterrier
FAISS support OpenAIEmbedding and HuggingFaceEmbedding ("sentence-transformers/all-mpnet-base-v2"). Using HuggingFaceEmbedding as OpenAI one need $$

michaelthwan commented 1 year ago

Related tuning #35

michaelthwan commented 1 year ago

39

FAISS-openai is pretty good