Since Response.text of fetch is always decoded using UTF-8, I need to change some code for scraping non-unicode site. (Yeah, it still existing...)
I think providing option for it will be nice feature for this library. returning arraybuffer if option is provided. so I can use decode(py) or TextEncoder(js) for decoding characters properly.
Since
Response.text
offetch
is always decoded using UTF-8, I need to change some code for scraping non-unicode site. (Yeah, it still existing...) I think providing option for it will be nice feature for this library. returning arraybuffer if option is provided. so I can usedecode
(py) orTextEncoder
(js) for decoding characters properly.CC: https://stackoverflow.com/questions/55282444/javascript-fetch-characters-with-encoding-issues