Hello, I just tested with dev_2.0 and rag-chat branches, and I think we need to update the table relations.
When the link is saved,
links table creates a row with link, content
Cleaned/scrapped data is saved into link.content
embed() will create document_sections table with split chunks
embeddings are saved into document_sections.embedding
When the category is created,
Saved into categories table with category_name, user_id
Also saved into category_link_relation with link(website), category
As you can see from the picture, there is no relationship between link and documents right now.
To fix this issue, in my opinion, we need to update link.purpose into link.category so we can have a relationship.
However, if you have any other suggestions, please feel free to write them down here.
Hello, I just tested with
dev_2.0andrag-chatbranches, and I think we need to update the table relations.When the link is saved,
linkstable creates a row with link, contentlink.contentembed()will createdocument_sectionstable with split chunksdocument_sections.embeddingWhen the category is created,
categoriestable with category_name, user_idcategory_link_relationwith link(website), categoryAs you can see from the picture, there is no relationship between
linkanddocumentsright now. To fix this issue, in my opinion, we need to updatelink.purposeintolink.categoryso we can have a relationship. However, if you have any other suggestions, please feel free to write them down here.