Open d47081 opened 1 year ago
Some pages have unsupported character set that causes DB error in crawler
it have been temporarily fixed but requires proper solution (without db character set changing),
so I found useful library that could solve this problem https://github.com/neitanod/forceutf8
Some pages have unsupported character set that causes DB error in crawler
it have been temporarily fixed but requires proper solution (without db character set changing),
so I found useful library that could solve this problem https://github.com/neitanod/forceutf8