-
I got a warning I think because my Cognito IDP URL results in a 3xx/400 without context, so the crawler thinks it's no good.
https://developers.facebook.com/community/threads/605080477083441/
> …
-
**URL**
https://www.facebook.com/meemoo.be (or any other facebook URL)
**Describe the bug**
When starting autopilot, it loads for some minutes and then autopilot stops. I think there's something …
-
@tnylea
- I just pushed the 'js' branch. it's not ready for PR yet but I want you to see this database setup to start thinking.
- You were right – JSON was the wrong direction.
- we'll be ab…
-
Issue Facebook-Scraper gets "Temporarily banned" but Firefox is working.
Same profile, same cookie, same IP, same user-agent.
Why is the crawler getting banned but not my normal firefox ?
-
There is a problem with a particular image links when scraping from Facebook
```
from gidown.advanced import Size
from gidown import image_query
# set query and the number of images wanted
qu…
-
It looks like issue #877 updated logic so that if a FB post had no "message" property, it used "name" instead. Looking at what's in the code now, though, that change has reverted. I'm looking at line …
-
@tyohan
Search engines are not able to crawl pages for the web app.
Facebook and Google are not able to crawl the contents of the page that are dynamically generated.
Hence, sharing on facebook…
-
I have been trying to use django-seo-js and [prerender.io](www.prerender.io) to display a preview of my React SPA on Facebook. However, it appears that the Facebook crawler is not rerouted to [prerend…
-
Hi, i saw in a changelog that :
> CHANGELOG
> =========
> 0.3.0
> -----
> * Add a PHPUnit extension to keep alive the webserver and the client between tests
>
> 0.2.0
> -----
> * Allow ke…
-
I've just tested the latest main branch functionality on Windows 11 or Ubuntu and encountered an issue. Here’s the test code I used:
```
python
async def main():
async with AsyncWebCrawler(
…