For tasks like these, the m2-bert-80M-8k-retrieval, as well as 2k or 32k versions seem to perform pretty well. I can choose the model in the RagSettings class after the chunk size has been established. If chunk size is changed from anywhere, it should automatically update the retrieval model appropriately. This makes use of the decorator functions, OOP, and the efficient manifest checks/caching.
For tasks like these, the m2-bert-80M-8k-retrieval, as well as 2k or 32k versions seem to perform pretty well. I can choose the model in the RagSettings class after the chunk size has been established. If chunk size is changed from anywhere, it should automatically update the retrieval model appropriately. This makes use of the decorator functions, OOP, and the efficient manifest checks/caching.