j0k3r / graby

Graby helps you extract article content from web pages
MIT License
365 stars 74 forks source link

Bloomber is detecting Wallabag/Graby as a robot #232

Open ngosang opened 4 years ago

ngosang commented 4 years ago

Example article: https://www.bloomberg.com/news/articles/2020-06-18/racism-is-rampant-on-reddit-and-its-editors-are-in-open-revolt

In the grabbed title you will see "Bloomberg - Are you a robot?" instead of the expected title. The body is empty.

I think the site-config is good.

Kdecherf commented 2 years ago

There's not a lot graby can do for this one, there are some mandatory Javascript validation that must be done manually when you hit this page.