search

Betterbird / thunderbird-patches

Betterbird is a fork of Mozilla Thunderbird. Here are the patches that provide all the goodness.
Other
509 stars 20 forks source link

Random messages are missing from a Saved Search Folder using complex filtering #368

Open viking2 opened 3 hours ago

viking2 commented 3 hours ago

I have a Saved Search Folder with 14 inboxes using complex filtering of the type discussed here (but without the last two lines): https://github.com/Betterbird/thunderbird-patches/issues/365

I often realize that random messages are missing from the Saved Search Folder. If I do a Quick Search on the folder using, for example, "Show only unread messages", I can see the missing messages. The messages are usually recent messages, 1-2 days old, and are in different inboxes.

I can, alternatively, find the missing messages if I update the Saved Search Folder. (However, it takes 4-5 min with very high CPU and makes my PC unresponsive. I currently need to do this several times/day).

I am not sure how to troubleshoot this?

Betterbird commented 2 hours ago

As we have already established many times, running a QF on a search folder repeats the search and doesn't apply the cache which is used to display the search folder when displaying it normally. Updating the search folder equally repeats the search, but caches the result, unlike QF.

How is this different to Issue #369 where also messages randomly disappear?

Search folders are maintained by observing changes to the base folders and then updating the cache for the search folder, so the next time you display the search folder, it displays from an update cache.

Overall, just line in Issue #369, we need a reproducible case. In a worst case, we can log cache changes to the console. It would also be good to know whether this reproduces without IMAP folders.

viking2 commented 44 minutes ago

It may indeed be identical to https://github.com/Betterbird/thunderbird-patches/issues/369 where several thousand messages are missing from the cache. However, I do not know which messages are missing in https://github.com/Betterbird/thunderbird-patches/issues/369.

In this case, I am aware of a few missing messages, but there may be thousands more. I didn't [yet] check if the message count had dropped significantly.

The count just now dropped again by about 1,000 messages. Is there some way to isolate which messages are missing (e.g. comparing a new search with the cache; I think that it may not be possible?)?