3.4.0 Decoding - Githubissues

laurengarcia / url-metadata

NPM module: Request a url and scrape the metadata from its HTML using Node.js or the browser.

https://www.npmjs.com/package/url-metadata

MIT License

166 stars 43 forks source link

3.4.0 Decoding #72

Closed laurengarcia closed 7 months ago

laurengarcia commented 7 months ago

Feature request:

opts.decode

defaults to auto, which auto-detects the charset according to rules in new file lib/extract-charset.js
follows html5 spec of using charset in response header Content-Type
falls back to auto-detecting from meta tags if no header found
if no charset is found in headers or meta tags, fall back to utf-8 per html5 spec
also allows user to manually pass in charset to opts.decode if they want to override auto-detection feature

requested in #70