pandeydivesh15 / NER-using-Deep-Learning

A project on achieving Named-Entity Recognition using Deep Learning.
MIT License
25 stars 14 forks source link

decoding not happenning #5

Open madhu168 opened 5 years ago

madhu168 commented 5 years ago

Hello,u haven't mentioned the type of decoding that has to happen in process_data.py in the method read_data and i have tried with utf-8 but it is still showing the same error. It would be a great help if u looked into this. I have attached a screenshot of the error. Screenshot (1)

pandeydivesh15 commented 5 years ago

Sorry for late replying

Can you replace the line

with codecs.open(datapath, 'r') as f:

by

with codecs.open(datapath, 'r', encoding='utf8') as f:

? See if this works. Also, are using the project's data or some other data?

madhu168 commented 5 years ago

Thanks,it worked for utf-8-sig,it isn't working for utf-8