-
Hey,
All of the sudden, Google, Facebook, and other crawlers started reporting my website as being unavailable. We're using `django-seo-js==0.2.4` and the paid version of Prerender.io. Testing usin…
-
### 📚 Is your documentation request related to a problem?
I personally would like to know what are the motivations behind this package, and what are the known limitations or limitations you have be…
-
The first run talked about the `legacy builder` being deprecated, the `--no-dev` option being deprecated and then failed with `Read on closed or unwrapped SSL socket`...although the script still repor…
-
### Feature Request
Linked to #30278 because I think it's linked to UX, and if we do something about this so we need to add Doc too.
## Why You Should Use `` Instead of `` or `` for JavaScript C…
-
-
### Which package is this bug report for? If unsure which one to select, leave blank
@crawlee/basic (BasicCrawler)
### Issue description
`minConcurrency` is a dangerous option and `desiredConcurren…
-
The constructor of the BufferedChangeEventInit is defined as optional
(https://www.w3.org/TR/media-source/#dom-bufferedchangeevent)
```
interface BufferedChangeEvent : Event {
constructor(DOMStr…
-
The objective is to do research on how to deploy a crawler script by the Crawler team in AWS and do a unit test in Travis CI.
- received access to an AWS account
- did research on the deployment i…
-
Does the Open Graph support imply that social media networks such as Facebook will scrape the correct information if the properties are set?
-
the two main things:
- [ ] generate a sitemap.xml of all the pages we want indexed and submit to https://search.google.com/search-console/about
- [ ] use [sitemaps' priority](https://www.sitemap…