search

extractus / article-extractor

To extract main article from given URL with Node.js
https://extractor-demos.pages.dev/article-extractor
MIT License
1.56k stars 134 forks source link

Feat: extract pagetype from og:type or ld+json #374

Closed andremacola closed 10 months ago

andremacola commented 10 months ago

This pull request addresses the issue https://github.com/extractus/article-extractor/issues/373 and includes several improvements:

1 - Refactoring of extractMetaData to avoid repetition and enhance maintainability. 2 - Adds extraction of JSON+LD Schema for certain parameters such as description, image, author, published and type in case they are not found by extractMetaData. This provides an additional extraction option for these parameters. 3 - Opens up the possibility to enhance and expand the extraction of other parameters through the JSON+LD Schema. 4 - Adds a test for extractLDSchema. 5 - Adds the OG:TYPE meta tag based on https://schema.org/docs/full.html (returns only types related to articles, blogs, and websites).

No external dependencies were used, only the logic from the article-extractor itself.

ndaidong commented 10 months ago

@andremacola thank you, I will check and merge this soon.