Crash when deleting items concurrent with a search, crash on blooming deleted id

[GoogleCodeExporter]

What steps will reproduce the problem?
1. When deleting something from Thrudex concurrent with a search, sometimes
it will crash
2. Restarting Thrudex crashes at the bloom stage

What is the expected output? What do you see instead?

74645575 [2989390736] DEBUG CLuceneIndex  - Syncing Started
74645750 [2647563152] DEBUG CLuceneIndex  - Searching in: (row)
74646385 [2904460176] DEBUG CLuceneIndex  - Syncing
74646385 [2904460176] DEBUG CLuceneIndex  - Syncing Finished
74647285 [2647563152] DEBUG CLuceneIndex  - Created new searcher
74647285 [2647563152] DEBUG CLuceneIndex  - tableid:DusdIaAkHye4 
74647285 [2647563152] DEBUG CLuceneIndex  - Sorting by: ts Descending
74647286 [2989390736] DEBUG CLuceneIndex  - Created Handles
74647287 [2989390736] DEBUG CLuceneIndex  - DeletedlMoVoaoguJFl
74647288 [2989390736] DEBUG CLuceneIndex  - Deleted old ids
74647335 [2647563152] WARN  CLuceneIndex  - Sort failed, falling back on
regular search
[crash]

[after restart]
[...]
1774 [3076573776] DEBUG CLuceneIndex  - blooming index id: row(4mtoe6lKH6rb)
1775 [3076573776] DEBUG CLuceneIndex  - blooming index id: row(mrsBH0irYvsu)
1775 [3076573776] ERROR CLuceneIndex  - Clucene Exception while creating
index:index/row : attempt to access a deleted document
[crash]

###checking with Apache Lucene CheckIndex reveals one deleted document but
no problems
# checkindex beta row -fix
Opening index @ /export/db/beta/thrudb/server/index/row

Segments file=segments numSegments=1 version=-1 [Lucene 1.3 or prior]
  1 of 1: name=_1f docCount=18
    compound=false
    hasProx=true
    numFiles=45
    size (MB)=1.311
    has deletions [delFileName=_1f.del]
    test: open reader.........OK [1 deleted docs]
    test: fields, norms.......OK [37 fields]
    test: terms, freq, prox...OK [8605 terms; 12750 terms/docs pairs; 37615
tokens]
    test: stored fields.......OK [377 total field count; avg 22.176 fields
per doc]
    test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

No problems were detected with this index.

Original issue reported on code.google.com by aris...@gmail.com on 27 Jan 2009 at 5:26

[GoogleCodeExporter]

If you are able to reproduce this could you attach a backtrace of the crash?  I 
can take care of the bloom filter 
error.

Original comment by jake%3.r...@gtempaccount.com on 28 Jan 2009 at 3:34

• Changed state: Accepted

[GoogleCodeExporter]

Thrudex now checks if the document is deleted before it adds it to the filter.

Original comment by jake%3.r...@gtempaccount.com on 31 Jan 2009 at 6:24

• Changed state: Fixed