almutareb / insurance-advisor-agent

0 stars 0 forks source link

Generate summaries and keywords for each chunk #47

Closed almutareb closed 3 months ago

almutareb commented 3 months ago

Is your feature request related to a problem? Please describe. We have a PoC to generate summaries and keywords of documents and chunks, but it failed due to HF model overloaded issue. We need an alternative lightweight method

Describe the solution you'd like Use a smaller model to generate keywords and summaries for existing chunks in the vectorstore Test if it works better within the same collection, in a separate collection or in a separate db