performance improvements

microlinkhq / metascraper

Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.

https://metascraper.js.org

MIT License

2.35k stars 168 forks source link

performance improvements #518

Closed Kikobeats closed 2 years ago

Kikobeats commented 2 years ago

maximise HIT ratio

[x] use normalizeUrl instead of absoluteUrl when is possible.

use keyvhq/memoize

[x] metascraper-audio/video: for getting twitter player html.
[x] metascraper-logo-favicon: since an /favicon.ico can return 404.
[x] metascraper-spotify: for getting spotify embed player.
[x] metascraper-clearbit: for storing domain association
[x] metascraper-manifest: associated a URL with a JSON payload.

coveralls commented 2 years ago

Coverage increased (+0.1%) to 97.865% when pulling fa9e0d0c70739f31b9161abf35baf3c63ab3fd7b on next into 3e9f58dcb90dea7b3f15440d5a055b0744184c24 on master.