Open hkkenneth opened 7 years ago
Further explanation:
Why cannot do this in reader: if reading an item fails, we know nothing about this item, nothing about document ID, patient ID etc.
Why cannot do this in writer: if writing to ElasticSearch has problem, writing the dummy placeholder to ES will not succeed...
When this option is on, even when a non-optional processor fails, it will trigger a record to be written to elastic search.
However, note that we possibly cannot catch failure in reader and writer in the same way...