-
### Problem Description
There are a lot of ways to start a docker container that needs a local file. Currently, we document doing it with `docker run` and `docker cp` like:
```
$ docker run -i -d \
…
-
Hi all,
We have been using AIL framework for some time now.
Is there a possibility to clear or delete the queue of the crawler?
If not, this would be a great feature!
After a while, my queue …
-
**Scrapper**
1. Creating a scrapper at first to scrape the first 10 "Google Search Results"
2. Maintain a list of the URLs of the search result.
-
Website:
https://internshala.com/
Input:
```
city
category or keyword
```
-
Website:
https://www.glassdoor.com
-
Is it just me or the crawler seemed slow even with 16 workers?
I imagine it's slow because the browser is rendering the whole page before doing anything with them, rather than just make out stuff w…
-
when using request_crawler, it always shows out the error:
UnhandledPromiseRejectionWarning: TypeError: fRequest.getRequestKey is not a function, and the result in request_data.json has no any _pos…
-
I have noticed that a crawler stopped importing data. I see the following errors in the log
```
2024-01-31 14:30:00 INFO Macroscope.Worker:183: Looking for oldest entity {"index":"demo","crawl…
-
Hi Marevol,
do you think that a crawling interface with the most popular mail systems could be useful?
Happy Holidays
Luigi
-
I have a question about using jsop api to select the target element.
Here is the HTML.
![image](https://cloud.githubusercontent.com/assets/23108630/26614981/6b4767d8-4589-11e7-993d-433af28b40dc.png…