-
At committer.commitBatch() function I try to get page's content for database writing.
``` java
public class CustomCommitter extends AbstractMappedCommitter {
...
@Override
protected void comm…
-
Hello!
I write my own committer implementation to put collected pages into MySQL database.
As an example I've taken SolrCommiter - is it a right decision?
So I inherited from AbstractMappedCommitt…
-
Hello,
I plan to write my own commiter, which writes only new (not updated) pages to a local filesystem.
Reading FileSystemCommiters sources I can't get, how to recognize the page is new. Is it poss…
-
After running continuously for quite some time on Windows, the committer will have created a lot of folders (more than 500 000 in my case).
This is extremely performance degrading on Windows.
Curren…
-
I would like to know may collector-http fit requirements for the following task (I appreciate your precious time, and read documentation first, but haven't found some nuances):
A set of hundreds web …
-
I'm running on
- norconex-collector 1.2.0
- norconex-committer-solr-1.0.1
- Oracle JRE 1.7.0_51
- Windows Server 2008 R2
This exception (se below) occurs quite frequently in the logs.
It seems to ha…
-
The extracted URLs of pages that have been redirected are wrong because the original URL is taken as the basis to build the extracted URLs and not the current redirected location.
E.g. `www.example.c…
-
Hello,
Sometimes we need to pass parameters with Solr Commiter URL. This is very useful especially when dealing with something like LucidWorks.
Here is an example of what would be done:
htt…