search

michaelthwan / searchGPT

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.
MIT License
622 stars 65 forks source link

Reference Generator tuning #16

Closed michaelthwan closed 1 year ago

michaelthwan commented 1 year ago

Currently using Tf, score >= 5 as the rule for filtering correct reference. See if there is needs for tuning. (e.g. too many responses have no reference)

Related code, in FootnoteService

SCORE_THRESHOLD = 5
result_within_scope_df = result_df[result_df['score'] >= SCORE_THRESHOLD]
michaelthwan commented 1 year ago

Related tuning #35