search

inhumantsar / slurp

Slurps webpages and saves them as clean, uncluttered Markdown. Think Pocket, but better.
https://inhumantsar.github.io/slurp/
MIT License
177 stars 6 forks source link

Slurp seems to have stopped working today #50

Open davidberreby opened 4 months ago

davidberreby commented 4 months ago

Hi, Obsidian 1.6.5 on a Macbook Air M3 running Sonoma -- Slurp throws up errors.

URLs that failed:

https://www.breastcancer.org/research-news/men-at-high-risk-benefit-from-mammograms

https://coned-findacontractor.icfsightline.com/

One URL -- a New York Times news story -- went through.

inhumantsar commented 3 months ago

Firefox is able to parse the breastcancer.org link using Readability. breastcancer.org might be blocking requests from scripts like Slurp, i've seen that before with other sites. there also might be something off in the preparsing steps. i'll take a look this weekend and see what's up.

the icfsightline page is a type that often isn't parseable by Slurp. pages that dynamically load information or don't contain much text generally can't be parsed since slurp can't operate a form, run javascript, or simplify a page that doesn't have information to simplify. i'll have a look at it as well, but i'm fairly certain it's simply not compatible.

i'll also have a look at improving that error message to better indicate when a page is simply incompatible.

thanks for the report!

davidberreby commented 3 months ago

Thanks for the answer! Not surprised about the icfsightline page, as it’s dynamic and I thought that might be trouble.

Wanted to flag these because generally Slurp works like a charm. It’s really useful plugin. Thanks for making and maintaining it!

David

David Berreby www.davidberreby.com On Jul 19, 2024 at 6:00 PM -0400, Shaun Martin @.***>, wrote:

Firefox is able to parse the breastcancer.org link using Readability. breastcancer.org might be blocking requests from scripts like Slurp, i've seen that before with other sites. there also might be something off in the preparsing steps. i'll take a look this weekend and see what's up. the icfsightline page is a type that often isn't parseable by Slurp. pages that dynamically load information or don't contain much text generally can't be parsed since slurp can't operate a form, run javascript, or simplify a page that doesn't have information to simplify. i'll have a look at it as well, but i'm fairly certain it's simply not compatible. i'll also have a look at improving that error message to better indicate when a page is simply incompatible. thanks for the report! — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>