search

grambank / pygrambank

Apache License 2.0
4 stars 1 forks source link

recode encoding #65

Closed HedvigS closed 2 years ago

HedvigS commented 2 years ago

Sometimes when i use recode on sheets, I get unexpected and unsatisfactory output. For example:

�àMarking��� -> Èà MarkingÈÃÍ

(this happened for example with JSA_inon1237 in this PR)

I'm guessing I have to change the expected encoding. I tried mixed, cp1252 and macroman and all had weird (but different) results.

I also suspect this has to do with german style "smart" quotes.

HedvigS commented 2 years ago

This branch has the same issue.

HedvigS commented 2 years ago

Same thing happened here, I fixed it "by hand"

xrotwang commented 2 years ago

I suspect this is some kind of mojibake, but didn't find a way to detect/fix it automatically.

HedvigS commented 2 years ago

Okay. It is what it is. If this is located to only JSA's machine we may not need to worry because she's leaving as a coder soon.