gomate-community / GoMate

GoMate:RAG Framework within Reliable input,Trusted output
557 stars 51 forks source link

import datrie ModuleNotFoundError: No module named 'datrie' #70

Closed cristianohello closed 1 month ago

cristianohello commented 1 month ago

GoMate-main\gomate\modules\document\rag_tokenizer.py", line 19, in

这个脚本从哪找的? import datrie ModuleNotFoundError: No module named 'datrie'

这个datrie干啥的?

yanqiangmiffy commented 1 month ago

pip install datrie

是用来加载huqie此表的

cristianohello commented 1 month ago

@yanqiangmiffy 能不用这个嘛?怎么注释掉

yanqiangmiffy commented 1 month ago

那就是不用rag_tokenizer这个分词器就可以了,可以用其他nltk或者jiba即可,你可以把涉及到rag_tokenizer的代码屏蔽了,换成一个类似的分词器