import datrie ModuleNotFoundError: No module named 'datrie'

gomate-community / TrustRAG

TrustRAG：The RAG Framework within Reliable input,Trusted output

571 stars 52 forks source link

Closed cristianohello closed 1 month ago

cristianohello commented 2 months ago

GoMate-main\gomate\modules\document\rag_tokenizer.py", line 19, in

这个脚本从哪找的？ import datrie ModuleNotFoundError: No module named 'datrie'

这个datrie干啥的？

yanqiangmiffy commented 2 months ago

pip install datrie

是用来加载huqie此表的

cristianohello commented 2 months ago

@yanqiangmiffy 能不用这个嘛？怎么注释掉

yanqiangmiffy commented 2 months ago

那就是不用rag_tokenizer这个分词器就可以了，可以用其他nltk或者jiba即可，你可以把涉及到rag_tokenizer的代码屏蔽了，换成一个类似的分词器