search

jsuto / piler

Email archiving application
https://www.mailpiler.org/
Other
82 stars 9 forks source link

pilerimport failed #171

Closed schickel007 closed 2 months ago

schickel007 commented 2 months ago

pilerimport does not work.

To Reproduce Executing: pilerimport -K mailserver.example.com -u archive@mailserver.example.com -p xxxxxxxx -P 995 -r

Error: found 1 messages processing: pop3-tmp-26560-1.txt failed to import: pop3-tmp-26560-1.txt (id: 5000000066cd83c20ecf86dc00c5c49d4497)

log:

Aug 27 09:53:03 mailserver pilerimport[31395]: unknown key: "clamd_socket"
Aug 27 09:53:03 mailserver pilerimport[31395]: added mydomain: 'local'
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: hdr_len: 2959, offset: 3
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: touch a522350330900f4a58c91ffaea8ee65dc8522085fbd78c5f4fd0c885df2f3438 OK (<CAOrw3Ym-Dp8FH+5MyCc0ZuAusNy2O4a-M4_0jpV_kp+DLY=bwQ@mail.gmail.com>)
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: stored '5000000066cd85e9073ed9cc00d270d5a406.m' 3183/1744 bytes
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: stored 1 recipients, rc=0
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406 failed to store index data for id=8, errno=1064, append ret=0
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM sph_index WHERE id=8
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM rcpt WHERE id=8
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM metadata WHERE id=8
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM attachment WHERE piler_id='5000000066cd85e9073ed9cc00d270d5a406'
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: unlinking /var/piler/store/00/66c/a4/06/5000000066cd85e9073ed9cc00d270d5a406.m
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: stored metadata, rc=1
Aug 27 09:53:03 mailserver pilerimport[31395]: server=mailserver.example.com, user=archive@mailserver.example.com, directory=(null), imported=0, duplicated=0, discarded=0

Expected behavior mail should be imported

Piler version:

Build Date: Mon Aug 26 13:37:53 CEST 2024 ldd version: ldd (Debian GLIBC 2.36-9+deb12u7) 2.36 gcc version: gcc version 12.2.0 (Debian 12.2.0-14) OS: Linux mailserver 6.1.0-23-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.99-1 (2024-07-15) x86_64 GNU/Linux Configure command: ./configure --localstatedir=/var --with-database=mysql --enable-memcached MySQL client library version: 3.3.8 Extractors: /usr/bin/pdftotext /usr/bin/catdoc /usr/bin/catppt /usr/bin/xls2csv /usr/bin/unrtf /usr/bin/tnef libzip

jsuto commented 2 months ago

Can you format the log output? It's unreadable as it is currently.

schickel007 commented 2 months ago

Comment edited

jsuto commented 2 months ago

Thank you. I suspect that the index settings are not in sync between manticore and piler. Check the rtindex settings in piler.conf, and the RT value in manticore.conf.

schickel007 commented 2 months ago

Adapting RT value fixed this issue

thx

swartjie commented 1 month ago

Adapting RT value fixed this issue

thx

What should I adapt it to? It's currently: /usr/local/etc/piler/manticore.conf:define('RT', 1); and: rtindex=1 in /usr/local/etc/piler/piler.conf