coderabbit214 / bibliothecarius

Quickly build services to integrate your local data and AI models.
MIT License
457 stars 79 forks source link

DocumentService中的txtSplit方法,如果文章最后没有标点符号会丢内容 #18

Closed easycoder666 closed 1 year ago

easycoder666 commented 1 year ago

while循环结束后,回收一下 String recycleParagraph = sb.toString(); if (StringUtils.isNotEmpty(recycleParagraph)) { splitContentList.addAll(recycleParagraph); }

caoshengdong commented 1 year ago

非常感谢,我们近期会对这部分进行一下改造,弃用目前这种简陋的拆分方式。