search

jacktuck / unfurl

Metadata scraper with support for oEmbed, Twitter Cards and Open Graph Protocol for Node.js :zap:
MIT License
479 stars 51 forks source link

Is it worth doing a HEAD request to make sure we have HTML? #10

Closed jacktuck closed 7 years ago

jacktuck commented 7 years ago

HEAD requests don't have to download any response body

Test whether it make sense doing a HEAD and then a GET.

Or is that optimizing for an uncommon case?

jacktuck commented 7 years ago

👎