Open aliabbasjp opened 7 years ago
Thanks for these reports. This is a weird one---the json
output of the CoreNLP parser cannot be understood by Python's json
module. So, the problem is not really on corpkit's side, but CoreNLP's.
Similar bugs have been reported to CoreNLP: https://github.com/stanfordnlp/CoreNLP/issues/241
I'm guessing that it relates to the encoding in your text files. Would you be able to zip and upload the files in the unparsed/parsed versions of the corpus? This would help me diagnose the problem and make a fix.
Also, I'd recommend encoding your text files as UTF-8---that should fix this problem in your case. Or, as per the instructions on the issue linked above, update the CoreNLP installed to the GitHub version. If corpkit installed CoreNLP for you, it should be in your ~/corenlp
directory.
Follwing error