search

grosjo / fts-xapian

Dovecot FTS plugin based on Xapian
GNU Lesser General Public License v2.1
91 stars 19 forks source link

Debian 12 Error: FTS Xapian: Can not allocate ICU translator (2) #159

Closed grovenigh closed 3 months ago

grovenigh commented 3 months ago

I get this error message if I search for example recipients with more than 22 chars. Version 1.7.8 has not this error. Debian 12 ships with icu-dev 72.1, upgrade seems not possible with ease.

Sadly I can't find debug symbols in my apt repo.

I also reindexed everything and deleted xapian-index/ folder.

Stack trace of thread 763673:
                #0  0x00007febe6a55e2c n/a (libc.so.6 + 0x8ae2c)
                #1  0x00007febe6a06fb2 raise (libc.so.6 + 0x3bfb2)
                #2  0x00007febe69f1472 abort (libc.so.6 + 0x26472)
                #3  0x00007febe5a9d919 n/a (libstdc++.so.6 + 0x9d919)
                #4  0x00007febe5aa8e1a n/a (libstdc++.so.6 + 0xa8e1a)
                #5  0x00007febe5aa8e85 _ZSt9terminatev (libstdc++.so.6 + 0xa8e85)
                #6  0x00007febe5aa90d8 __cxa_throw (libstdc++.so.6 + 0xa90d8)
                #7  0x00007febe5a9d524 n/a (libstdc++.so.6 + 0x9d524)
                #8  0x00007febe6632b53 _ZN9XQuerySet6addIcuEPN6icu_7213UnicodeStringES2_b (lib21_fts_xapian_plugin.so + 0x1bb53)
                #9  0x00007febe6632ba2 _ZN9XQuerySet6addIcuEPN6icu_7213UnicodeStringES2_b (lib21_fts_xapian_plugin.so + 0x1bba2)
                #10 0x00007febe6632ba2 _ZN9XQuerySet6addIcuEPN6icu_7213UnicodeStringES2_b (lib21_fts_xapian_plugin.so + 0x1bba2)
Program terminated with signal SIGABRT, Aborted.
#0  __pthread_kill_implementation (threadid=<optimized out>, signo=signo@entry=6, no_tid=no_tid@entry=0) at ./nptl/pthread_kill.c:44
44  ./nptl/pthread_kill.c: Datei oder Verzeichnis nicht gefunden.
2024-05-26T01:23:31.382081+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Starting with partial=3 full=20 verbose=2 lowmemory=250 MB vs freemem=18158 MB
2024-05-26T01:23:31.382732+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_get_last_uid
2024-05-26T01:23:31.382798+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Set box 'INBOX' (12345678)
2024-05-26T01:23:31.382844+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Index path = /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes
2024-05-26T01:23:31.382867+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_open_readonly
2024-05-26T01:23:31.382896+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Opening DB (RO) /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes/db_12345678>
2024-05-26T01:23:31.383055+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Get last UID of INBOX (12345678) = 1367
2024-05-26T01:23:31.383098+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_refresh
2024-05-26T01:23:31.383140+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_get_last_uid
2024-05-26T01:23:31.383170+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Set box 'INBOX' (12345678)
2024-05-26T01:23:31.383194+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Box is unchanged
2024-05-26T01:23:31.383226+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_open_readonly
2024-05-26T01:23:31.383253+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Opening DB (RO) /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes/db_12345678>
2024-05-26T01:23:31.383456+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Get last UID of INBOX (12345678) = 1367
2024-05-26T01:23:31.383494+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_lookup
2024-05-26T01:23:31.383523+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Set box 'INBOX' (12345678)
2024-05-26T01:23:31.383547+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Box is unchanged
2024-05-26T01:23:31.383572+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_open_readonly
2024-05-26T01:23:31.383599+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Opening DB (RO) /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes/db_12345678>
2024-05-26T01:23:31.383629+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: FLAG=AND
2024-05-26T01:23:31.383656+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_build_qs
2024-05-26T01:23:31.383685+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_query ()
2024-05-26T01:23:31.383729+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Query '' -> 0 results
2024-05-26T01:23:31.383776+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: 0 results in 0 ms
2024-05-26T01:23:31.383808+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_lookup
2024-05-26T01:23:31.383833+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Set box 'INBOX' (12345678)
2024-05-26T01:23:31.383858+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Box is unchanged
2024-05-26T01:23:31.383882+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_open_readonly
2024-05-26T01:23:31.383906+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: Opening DB (RO) /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes/db_12345678>
2024-05-26T01:23:31.383942+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: FLAG=OR
2024-05-26T01:23:31.383987+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: FTS Xapian: fts_backend_xapian_build_qs
2024-05-26T01:23:36.081514+02:00 mail dovecot: imap(info@example.de)<763673><huuBkk8ZXON/AAAB>: Error: FTS Xapian: Can not allocate ICU translator (2)
2024-05-26T01:23:36.330995+02:00 mail dovecot: imap: Error: terminate called after throwing an instance of 'std::bad_alloc'
2024-05-26T01:23:36.331267+02:00 mail dovecot: imap: Error:   what():  std::bad_alloc
grosjo commented 3 months ago

Try latest git

grovenigh commented 3 months ago

Try latest git

Problem persists. But now I just get "killed with signal 11" for search by 20 char recipient. No Icu Errors to see. Will gather more debug information later.

Also in Mail Client there is no more "Failed to send Query UID" or so. Just 0 results.

Found that in my dmesg: [1248566.327368] imap[787484]: segfault at 7fff089abfec ip 00007fbcac342fd1 sp 00007fff089abfb0 error 6 in libicuuc.so.72.1[7fbcac26b000+f1000] likely on CPU 3 (core 0, socket 3)

        Signal: 11 (SEGV)
Stack trace of thread 789780:
                #0  0x00007f3f3b94303c n/a (libicuuc.so.72 + 0x14103c)
                #1  0x00007f3f3b94466e ustrcase_internalToLower_72 (libicuuc.so.72 + 0x14266e)
                #2  0x00007f3f3b92eed6 _ZN6icu_7213UnicodeString7caseMapEijPNS_13BreakIteratorEPFiijS2_PDsiPKDsiPNS_5EditsER10UErrorCodeE (libicuuc.so.72 + 0x12ced6)
                #3  0x00007f3f3bddd535 _ZN9XQuerySet3addEPN6icu_7213UnicodeStringES2_bPNS0_14TransliteratorE (lib21_fts_xapian_plugin.so + 0x1b535)
                #4  0x00007f3f3bddddde _ZN9XQuerySet3addEPN6icu_7213UnicodeStringES2_bPNS0_14TransliteratorE (lib21_fts_xapian_plugin.so + 0x1bdde)
                #5  0x00007f3f3bddddde _ZN9XQuerySet3addEPN6icu_7213UnicodeStringES2_bPNS0_14TransliteratorE (lib21_fts_xapian_plugin.so + 0x1bdde)
                #6  0x00007f3f3bddddde _ZN9XQuerySet3addEPN6icu_7213UnicodeStringES2_bPNS0_14TransliteratorE (lib21_fts_xapian_plugin.so + 0x1bdde)
2024-05-27T00:52:26.167352+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: fts_backend_xapian_open_readonly
2024-05-27T00:52:26.167380+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: Opening DB (RO) /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes/db_1235678>
2024-05-27T00:52:26.167409+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: FLAG=AND
2024-05-27T00:52:26.167471+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: fts_backend_xapian_build_qs
2024-05-27T00:52:26.167510+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: fts_backend_xapian_query ()
2024-05-27T00:52:26.167542+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: Query '' -> 0 results
2024-05-27T00:52:26.167572+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: 0 results in 0 ms
2024-05-27T00:52:26.167607+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: fts_backend_xapian_lookup
2024-05-27T00:52:26.167636+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: Set box 'INBOX' (12345678)
2024-05-27T00:52:26.167658+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: Box is unchanged
2024-05-27T00:52:26.167677+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: fts_backend_xapian_open_readonly
2024-05-27T00:52:26.167696+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: Opening DB (RO) /var/vmail/mailboxes/example.de/info/mdbox/xapian-indexes/db_1235678>
2024-05-27T00:52:26.167714+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: FLAG=OR
2024-05-27T00:52:26.167737+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: FTS Xapian: fts_backend_xapian_build_qs
2024-05-27T00:52:26.822716+02:00 mail dovecot: imap(info@example.de)<789780><QissQWMZLrB/AAAB>: Fatal: master: service(imap): child 789780 killed with signal 11 (core dumped)
grosjo commented 3 months ago

Please check again with latest git

grovenigh commented 3 months ago

Seems to work now :) Will check deeper later, thank you!