Open dantetemplar opened 1 month ago
I guess this if-statement can not be reached. (no "punkt" key in dictionary).
https://github.com/AmenRa/retriv/blob/0c418a87f06a66e89d388ea3bf52575faf287d91/retriv/sparse_retriever/preprocessing/tokenizer.py#L17-L18
I guess this if-statement can not be reached. (no "punkt" key in dictionary).
https://github.com/AmenRa/retriv/blob/0c418a87f06a66e89d388ea3bf52575faf287d91/retriv/sparse_retriever/preprocessing/tokenizer.py#L17-L18