gottfrois / link_thumbnailer

Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
MIT License
512 stars 106 forks source link

Add option to fetch full content of the webpage #131

Closed Pimentoso closed 1 year ago

Pimentoso commented 6 years ago

Hi, I'm not sure this function makes sense in the context of a link thumbnailer, but I implemented it for personal use and it works, so feel free to reject this PR.

Basically when the url gets scraped, you can get the full content of all the <p> tags of the page in the body attribute (all tags stripped and squished). Maybe it can make sense as an optional attribute in the configuration.