search

raviqqe / muffet

Fast website link checker in Go
MIT License
2.49k stars 96 forks source link

Feature: Support metadata URLs used for open graph/twitter cards #268

Closed azeemba closed 1 year ago

azeemba commented 1 year ago

Websites can provide metadata like thumbnails/preview images using the <meta> tag. Open Graph is used by most platforms and Twitter has its own format but they all use <meta> tags where the content= attribute can contain a URL.

My use case is that I crawl my website locally to make sure that I don't have any broken links in the meta URLs. So I would find this feature helpful.

I am happy to send a PR but wanted to check if there is interest in this feature first.

raviqqe commented 1 year ago

Sounds good to me! And if you want to implement it, of course, you're welcome!

One concern is that the <meta /> tags' content property can mean anything depending on their attributes. OpenGraph is a kind of defacto standard but I believe there are also similar use cases for Twitter. I hope supporting meta tags doesn't bloat the feature and maintenance burden in the future. 😅

azeemba commented 1 year ago

The code change turned out to be pretty small but its definitely a valid concern. I will push a PR so you can share your thoughts