aadsm / jschardet

Character encoding auto-detection in JavaScript (port of python's chardet)
GNU Lesser General Public License v2.1
706 stars 97 forks source link

GBK not detected in this case #34

Open bpasero opened 7 years ago

bpasero commented 7 years ago
EUC-TW prober hit error at byte 0

windows-1251 confidence = 0, below negative shortcut threshhold 0.05

UTF-8 not active

SHIFT_JIS confidence = 0.01

EUC-JP confidence = 0.6666666666666666

GB2312 confidence = 0

EUC-KR confidence = 0

Big5 confidence = 0

EUC-TW not active

UTF-8 not active

SHIFT_JIS confidence = 0.01

EUC-JP confidence = 0.6666666666666666

GB2312 confidence = 0

EUC-KR confidence = 0

Big5 confidence = 0

EUC-TW not active

EUC-JP confidence 0.6666666666666666
windows-1251 confidence = 0

KOI8-R confidence = 0

ISO-8859-5 confidence = 0.17355247990093067

MacCyrillic confidence = 0.01

IBM866 confidence = 0.01

IBM855 confidence = 0.01

ISO-8859-7 confidence = 0

windows-1253 confidence = 0

ISO-8859-5 confidence = 0.17484312375564148

windows-1251 not active

ISO-8859-2 confidence = 0.01

windows-1250 confidence = 0.01

TIS-620 confidence = 0.4613092462002095

windows-1255 confidence = 0

windows-1255 confidence = 0.01

windows-1255 confidence = 0.01

windows-1251 confidence = 0

KOI8-R confidence = 0

ISO-8859-5 confidence = 0.17355247990093067

MacCyrillic confidence = 0.01

IBM866 confidence = 0.01

IBM855 confidence = 0.01

ISO-8859-7 confidence = 0

windows-1253 confidence = 0

ISO-8859-5 confidence = 0.17484312375564148

windows-1251 not active

ISO-8859-2 confidence = 0.01

windows-1250 confidence = 0.01

TIS-620 confidence = 0.4613092462002095

windows-1255 confidence = 0

windows-1255 confidence = 0.01

windows-1255 confidence = 0.01

TIS-620 confidence 0.4613092462002095
windows-1252 confidence 0.95
{ encoding: 'windows-1252', confidence: 0.95 }
fritx commented 5 years ago

+1, Expected: GB2312, Actual: ISO-8859-2

{ encoding: 'ISO-8859-2', confidence: 0.7195736160880659 }

View-Source: https://item.taobao.com/item.htm?ut_sk=1.W6CNtQbTxqIDAN9/fZ7CVUe7_21380790_1555428465987.TaoPassword-Weixin.1&id=569396429472&sourceType=item&price=499-799&suid=E6FA30BB-7B6D-41BD-B57C-6A4791EF135A&un=a531670cacfdfa7b3dd3af49e2902fce&share_crt_v=1&sp_tk=77+lclYxTllheW5ocVrvv6U=&cpp=1&shareurl=true&spm=a313p.22.33u.1027224231634&short_name=h.e0lKdVV