Open SaiSatwik opened 1 month ago
Hi @SaiSatwik Are you running a some sort of test?
Hi @mkhludnev
No. We have seen this issue in a VM where single node opensearch deployment is running. Due to this issue opensearch index went into RED state, leading to failure in any query on this index.
Pardon. I had a wrong clue about a change in test framework occurring later. Now, looking into the version you mention, I realized, it's wrong. Have no idea. Don't you have index sorting configured?
@mkhludnev , we do not have index sorting configured. But, could you please help me understand how can this issue could be related to index sorting configuration?
honestly, have no idea. How many docs you have in this index? May it exceed 2bns?
No. It would be hardly in thousands (max 50k).
This log is scary: out-of-order doc IDs, doc freq greater than total term freq, there is a major issue here. Are you doing something exotic on this index? Can you replicate this bug consistently? If so, does it still replicate if you use a more modern JDK (trying to check if there could be a JDK bug). Or can you run with assertions enabled and see if it reports a problem earlier?
Description
We are seeing docs out of order error multiple times on Opensearch 1.2.3. Seems issue is coming from lucene, but no clue what could be happening under the hood. No much significant spikes seen in disk i/o logs around the time of issue.
Version and environment details
Java Version:
lscpu output:
opensearch 1.2.3 is using lucene-core-8.10.1