-
```
from icrawler.builtin import GoogleImageCrawler
google_crawler = GoogleImageCrawler(
feeder_threads=1,
parser_threads=1,
downloader_threads=4,
storage={'root_dir': 'C:\\Use…
-
Hi I am trying to save pictures from each url. I'd like to know which pictures are from the same url. I tried to change the code in downloader.py, but it still gave me 1, 2, 3... file name for each im…
-
Hi,
I wrote a `ICrawlerEventListener`, something like that:
``` java
@Override
public void crawlerEvent(ICrawler crawler, CrawlerEvent event) {
if(CrawlerEvent.REJECTED_BAD_STATUS.equals(eve…
-
I've been using icrawler's google crawler for a while, but it seems like it's down now. Can we get the library updated?
-
I'm using dot net standard 2.1 and c# 8, I want to create an event for my class (interface), I follow [this tutorial](https://docs.microsoft.com/en-us/dotnet/standard/events/#events) and I wrote an in…
ghost updated
4 years ago
-
Hi
Just installed FastClass as per instructions on your [blog post](https://www.christianwerner.net/tech/Build-your-image-dataset-faster/)
Created a simple query file and ran the command as per yo…
-
I want to call functions/methods when the crawler starts and when it finishes.
To do thisn I can add a listener like this example using an anonymous inner class:
``` java
crawlerConfig.setCrawlerLi…
-
with `ICrawlerEventListener`, it's possible to intercept events of type [CrawlerEvent](https://norconex.com/collectors/collector-core/latest/apidocs/com/norconex/collector/core/crawler/event/CrawlerEv…
-
I implementing this :
```
import java.io.FileWriter;
import java.io.IOException;
import com.norconex.collector.core.CollectorException;
import com.norconex.collector.core.crawler.ICrawler;
imp…
-
I use JDBC as Data Store Factory (use H2).
``` xml
```
I create my own "Committer" and I would like to access the H2 database in this comitter.
To do this I did like this.
``` java
public clas…