-
I am getting the error `Could not process document: https://www.jobtransport.com/ (URL argument cannot be null.)`. I am able to open these websites in browser.
>
> [non-job]: 2020-03-05 08:12:42 …
-
Collector cannot start when its `*.index` file is empty (for whatever reason).
How to reproduce:
* start a collector and wait until it's done
* reset it's `index` file, e.g.:
```
> /var/norconex/…
-
I'm tested redirection with https://httpbin.davecheney.com/redirect/3. I add to `` config :
``` xml
10
200,302
```
I get:
> INFO [AbstractC…
-
Hi,
Is it possible to use SQL Committer with SQLite?
Do you have any examples of using SQL Committer?
Regards,
Christian
-
Hi we have a URLs in a .xml site map where in some date data need to be also crawled along with the URLs from the site map.
![image](https://user-images.githubusercontent.com/29800957/34831885-49264…
-
Hi there - does Norconex support incremental web crawls that would:
- Download headers first using the PROPFIND HTTP call to find the last modified date
- Lookup the date / time of the previous cr…
-
Hi,
currently i have the situation that i want to only have the "main" content parsed in an html document. Like this:
```xml
text/html
``…
-
Hi Pascal,
we have a long crawling process which takes approx. 4 days to complete a single crawl run. Today we got the following error message and the crawler stoped crawling `Crawler stopped.`
…
-
Using /norconex-collector-http-2.8.1
Directory structure is:
root@es-airflow:~/norconex-collector-http-2.8.1# ls
apidocs collector-http.bat committer-queue customer LICENSE.txt NOTICE.t…
-