almutareb / insurance-advisor-agent

0 stars 0 forks source link

Closed isayahc closed 1 month ago

isayahc commented 2 months ago

Changes made

made a chain for generating keywords
Using a Bert model in rag_app/utils/generate_keywords_keybert.py to also generate keywords
added keybert to requirements
added BERT_MODEL to environment variables

isayahc commented 2 months ago

@almutareb You want me to use a Bert model to generate keywords?

Describe the solution you'd like Expand the keywords of webpage and pdfs by generating keywords for each chunk using a smaller classification model

almutareb commented 2 months ago

Yes, let's try to utilize smaller models that we can run locally on edge like bert and avoid calling Mistral or Llama