-
it is possible to configure a log-file per crawler as it worked in v.2? I tried the following config, but `sd:type` does not get resolved. Thanks
```
%d{HH:mm:ss.SSS} […
-
As the title suggested, I checked the Norconext crawler. There are only three data fields from the crawled entries:
1. URL reference
2. meta-data
3. content with the HTML stripped.
Could you p…
-
I am crawling a website hosted by Drupal and using Norconex 2.9.x. I am crawling using a sitemap.
When pages are "deleted" they are actually just unpublished in Drupal and the web server returns a…
-
Hi Pascal.
I'm doing a POC for a client where every page is in a subdirectory, and there is no filename per se.
They also have a sitemap, but that's in a cutesy format from their SEO provider, and…
-
Hi. I'm using these versions of the Norconex Software:
```
Collector: Norconex HTTP Collector 3.0.2 (Norconex Inc.)
Collector Core: Norconex Collector Core 2.0.2 (Norconex Inc.)
Imp…
-
hi team
in norconex http collector if i am using default mv data store in this case it is not crawling duplicate data but if i am using the same configuration but i am using mongo db in this case…
-
I wonder if there is any other migration guide unless [Migrate to version 3](https://opensource.norconex.com/crawlers/web/v3/migration)? I couldn't figure out how to migrate this from version 2.9.1 to…
-
Hi!
First, I really like this lib! It works really great!
But now, I have an issue using the WebDriverHttpFetcher. My app is running as a Spring Boot (2.7.0) application with Java 17 on a Window…
-
Hello, I'm trying to extend the Norconex Committer system for my application (in Clojure).
I have the following code
`(def my-committer
(proxy
[LogCommitter]
[]
(doUpsert [u…
-
I am using version 3.0.1 of the Norconex collector.
When I try adding a WebDriverHttpFetcher to the crawler config, I get the following exception as soon as the crawl is started
```
Exception i…