Norconex / committer-elasticsearch

Implementation of Norconex Committer for Elasticsearch.
https://opensource.norconex.com/committers/elasticsearch/
Apache License 2.0
11 stars 6 forks source link

Deletion not working when a non "document.reference" value is used #38

Closed jetnet closed 5 years ago

jetnet commented 5 years ago

hello Pascal,

looks like an issue with deletion: docs don't get deleted from ES when the sourceReferenceField parameter is used:

<sourceReferenceField keep="false">id</sourceReferenceField>

BTW, when "id" is equal to "document.reference", then deletion works fine.

Version:

INFO  [AbstractCollector] Version: Norconex Committer Elasticsearch 4.1.0 (Norconex Inc.)

Thanks!

jetnet commented 5 years ago

I guess, it's a duplicate for https://github.com/Norconex/collector-http/issues/548

essiembre commented 5 years ago

Yes, it is a duplicate. For now, see if you can rely on the document.reference, with the help of the GenericURLNormalizer.