HTML5 charset declaration not detected

[guillaumepitel]

Hi, we've had some issues with charset detection for some websites. Current implementation on BUbiNG lacks the appropriate regex to detect HTML5 declarations :

We've implemented it, as well as a fallback using ICU probabilistic charset detection (with a dependency on ICU).

I think HTML5 charset detection could easily be submitted to the main repo. How do you stand regarding a potential dependency on ICU ?

[vigna]

We're perfectly fine with that. Please submit a pull request (including adding icu to ivy.xml). Thanks!

[ChuckNoxis]

13 👍