nsoft / jesterj

Document Ingestion Framework for Search Systems
Apache License 2.0
35 stars 33 forks source link

Allow for transformation of id field when writing to Solr #190

Closed nsoft closed 1 year ago

nsoft commented 1 year ago

There may be situations in which the id field needs to be constrained in some way. JesterJ's fault tolerance relies on id's to locate the documents for fault tolerant processing. Thus if fault tolerance is desired the user must never use Document.setId(String) or any similar operation. To alleviate this clash we should add a feature to SendToSolrProcessor that allows the user to specify a Function<String,Object> that can substitute an id for the document when we create the actual SolrInputDocument (without modifying JesterJ's Document object).