xiangking / ark-nlp

A private nlp coding package, which quickly implements the SOTA solutions.
Apache License 2.0
311 stars 65 forks source link

bug修复 #34

Closed xiangking closed 2 years ago

xiangking commented 2 years ago

PR types

Fix

PR changes

修复issue中提到的bug

Description

修复BaseDataset类本地数据读取问题,Closes https://github.com/xiangking/ark-nlp/issues/28 修复环境为GPU时,无法使用CPU的问题,Closes https://github.com/xiangking/ark-nlp/issues/29 完善SpanTokenizer分割后的字符未出现在模型的词嵌入中,增加了相关警告,Closes https://github.com/xiangking/ark-nlp/issues/30