search

hemingkx / ChineseNMT

ChineseNMT: Translate English to Chinese with PyTorch Implementation of Transformer
448 stars 90 forks source link

'\ufffd' in json #15

Open sjtuzzw opened 1 year ago

sjtuzzw commented 1 year ago

看上去json文件中存在一些'\ufffd'非法字符，他们在编码后会以“???”形式存在，我们应该怎么对待这些字符？