-
## Summary
With the `JOBDIR` setting the documentation states each spider should utilize its own directory, while there is nothing currently in place to automatically handle this as there is fo…
-
Is there plan to support the advanced fantasy tome?
-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
First of all thank you for such an amazing package.
This kind of a feature request:
Searching videos / running a query against a specific channel.
Example:
```js
const videos = await yts(…
-
Hi. I'm facing the following issue when working with unmodifiable collections in my classes.
Consider the following code:
**We have two types**
- Class which represents simple item with id f…
-
### Is your feature request related to a problem? Please describe
It would be great if the feature "Automatic add pages to Queue" would also work after flush of caches with cacheManager.
For examp…
Patta updated
5 months ago
-
It would be nice if I could parse dynamic endpoints(in SPIDER_SETTINGS) like: 'endpoint': 'crawl/'
-
There is a massive SEO problem with the way pagination works with JetSmartFilters.
The Jetsmartfilter pagination links to dynamic URLS like: example.com/{cpt_name}/?jet-smart-filters=jet-engine/(cp…
-
One of our users imported a dataset with few glue tables and then someone in their team accidentally ran a misconfigured Glue crawler that created 100,000+ glue tables in their DB..
This caused a L…