search

macanv / BERT-BiLSTM-CRF-NER

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
https://github.com/macanv/BERT-BiLSMT-CRF-NER
4.67k stars 1.25k forks source link

remove print func here due to UnicodeEncodeError #356

Open bqwu opened 4 years ago

bqwu commented 4 years ago

When I am using the trained NER model as service via http port, I found if the input json is something like query_json = { "id": 100, "texts": ["Beijing"] }, everything is right. However, if the input json is something like query_json = { "id": 100, "texts": ["北京"] }, then it raises Exception as below: UnicodeEncodeError: 'ascii' codec can't encode characters in position 23-25: ordinal not in range(128) I found this error comes from this print func and I think it should be removed here. In hanxiao's Bert-as-service, it does not contain this line (https://github.com/hanxiao/bert-as-service/blob/91bff1c2d0403e1afa9ee1af9dd9cb0dd58fe0d3/server/bert_serving/server/http.py#L57) and it supports Chinese well. So I suggest removing this print func here.

bqwu commented 4 years ago

Hope the author can release a new version for use later. Thanks so much.