search

AMP-SCZ / utility

Storehouse for all utility scripts
Apache License 2.0
0 stars 4 forks source link

fix: Use 'utf-8' -> 'latin-1' -> 'utf-8' to remove non-latin characters #115

Closed dheshanm closed 3 months ago

dheshanm commented 3 months ago

Addresses #114

tashrifbillah commented 3 months ago

Hi Dheshan, I think this work is still not right:

image

The ??? characters will be rejected by NDA validation tool. Or did we agree on letting the rejection happen?

tashrifbillah commented 3 months ago

We tried a lot. It is just so hard to do.

tashrifbillah commented 3 months ago

Due to conflict, merged via https://github.com/AMP-SCZ/utility/commit/bde2031090b8bbe75af59c9747392fbbad3dd6f4