run an undocumented function to convert from text/html to text/unicode mime types
undo the 1st conversion
I think we just want to convert utf8 to unicode ? is there an equivalent. the replacing of < and > and then unreplacing them does have dangers.
It is also worth noting that anything coming in from atom/rss feeds has already been through TextDecoder. It is likely that html scraping has also been treated like that (needs checking), so it is likely to be only useful for NNTP feeds (which should be utf8) - and that could probably also use the TextDecoder method.
What this does is
I think we just want to convert utf8 to unicode ? is there an equivalent. the replacing of < and > and then unreplacing them does have dangers.
It is also worth noting that anything coming in from atom/rss feeds has already been through TextDecoder. It is likely that html scraping has also been treated like that (needs checking), so it is likely to be only useful for NNTP feeds (which should be utf8) - and that could probably also use the TextDecoder method.