search

4teamwork / ftw.solr

Solr integration for Plone
5 stars 5 forks source link

Near Real Time Searching #131

Closed buchi closed 5 years ago

buchi commented 5 years ago

Perform soft commit on update. This make documents available for search almost immediately after being indexed. However changes are not yet saved to disk. Thus regular hard commits must be ensured by enabling autocommit.

The metadata of files is now indexed the same way as other content types to make them visible as soon as possible. They get indexed again using the extracting request handler which also indexes the blob data. This means that file metadata gets indexed twice because the extracting request handler does not support atomic updates.

buchi commented 5 years ago

autoCommit is already enabled in our solrconfig.xml. Currently we have a maxTime of 15s. I'm thinking about increasing that to 60s.

lukasgraf commented 5 years ago

@buchi right, I see - I thought I checked but somehow didn't spot that. +1 for increasing to 60s. As long as hard commits happen occasionally, I think durability of writes is not that critical in our scenario, since 100% of the data in Solr is derived.