search

Azure-Samples / azure-search-dotnet-utilities

C# code samples that help with admin or development tasks in Azure Cognitive Search.
MIT License
18 stars 17 forks source link

Data Loss in Partition Gaps #4

Closed FarzamMohammadi closed 9 months ago

FarzamMohammadi commented 1 year ago

Hi!

I've discovered a problem with the "partition-index" command, which is used to create index partitions. It works well for the most part, but occasionally, gaps in the partitions result in some actual data being omitted.

I initially thought the gaps between partitions were intended to prevent filtering for a date where there is no data. However, that's not the case. There have been instances where data exists in my index within those gaps, but it's not retrieved.

The partition JSON file always reflects accurate counts, but the data retrieved doesn't align with the expected count.

mattgotteiner commented 9 months ago

Thanks for reporting! We'll try to reproduce this

mattgotteiner commented 9 months ago

8 should help - @FarzamMohammadi please let me know if you can try again

FarzamMohammadi commented 9 months ago

Thanks @mattgotteiner, awesome work! Unfortunately, I won't be trying this again. I forked this a while ago and refined the features to suit my team's needs. Hopefully, the next users will benefit from your changes.

HeidiSteen commented 9 months ago

It sounds like the issue is resolved. I'm going to close this, but please reopen if there is further action required.