grosjo / fts-xapian

Dovecot FTS plugin based on Xapian
GNU Lesser General Public License v2.1
97 stars 21 forks source link

FTS Xapian: Term too long (> 245) #33

Closed dnoizeshakerz closed 4 years ago

dnoizeshakerz commented 4 years ago

How do I work around this problem? I didn't face such an issue with Solr. How do I increase the value to be higher than 245?

Thanks!

The exact error I've been getting is:

Jan 27 22:01:35 server dovecot[169473]: indexer-worker(service@*******.com)<102273><fwoVBDrtLl6ajQEAZMcJDA:PaBEHzrtLl6BjwEAZMcJDA>: Error: FTS Xapian: fts_backend_xapian_index_hdr (message-id) -> <!&!LGAAAAAAAABHQT8OHWLHTAITNLOCMNIOAQDDTO4Q93URZRTNAKOAU7BMAAAAAAAOAABGAAAAAAAAAGFBPW6HCUDNOHM2U5YY0G4HAMO2JHD3DRHOTM0AQGC7TUYAAAAAAA4AAJV66AZM+EDBOUDZYZ7QJVCAAAAADG4AAAAAAAAQAAAA9KEIF7HAYEIFHEXNFI7XGBIAAABSRTOGU3RPY2TLCIBWCMLUDAA=@XIDDIG.NET>
Jan 27 22:01:35 server dovecot[169473]: indexer-worker(service*******.com)<102273><fwoVBDrtLl6ajQEAZMcJDA:PaBEHzrtLl6BjwEAZMcJDA>: Error: FTS Xapian: Term too long (> 245): XMID!&!lgaaaaaaaabhqt8ohwlhtaitnlocmnioaqddto4q93urzrtnakoau7bmaaaaaaaoaabgaaaaaaaaagfbpw6hcudnohm2u5yy0g4hamo2jhd3drhotm0aqgc7tuyaaaaaaa4aajv66azm+edboudzyz7qjvcaaaaadg4aaaaaaaaqaaaa9keif7hayeifhexnfi7xgbiaaabsrtogu3rpy2tlcibwcmludaa=@xiddig net
grosjo commented 4 years ago

245 is the hard coded limit of Xapian library

What I can do is to transform this error into a warning (and the long word will just not be indexed in full)

Actuality, there is no real word above 245 characters, here is the internal "message-id" that is used /sometimes/ by Outlook

grosjo commented 4 years ago

Please try with latest git

dnoizeshakerz commented 4 years ago

Thank you!!