pilerimport failed

[schickel007]

pilerimport does not work.

To Reproduce Executing: pilerimport -K mailserver.example.com -u archive@mailserver.example.com -p xxxxxxxx -P 995 -r

Error: found 1 messages processing: pop3-tmp-26560-1.txt failed to import: pop3-tmp-26560-1.txt (id: 5000000066cd83c20ecf86dc00c5c49d4497)

log:

Aug 27 09:53:03 mailserver pilerimport[31395]: unknown key: "clamd_socket"
Aug 27 09:53:03 mailserver pilerimport[31395]: added mydomain: 'local'
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: hdr_len: 2959, offset: 3
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: touch a522350330900f4a58c91ffaea8ee65dc8522085fbd78c5f4fd0c885df2f3438 OK (<CAOrw3Ym-Dp8FH+5MyCc0ZuAusNy2O4a-M4_0jpV_kp+DLY=bwQ@mail.gmail.com>)
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: stored '5000000066cd85e9073ed9cc00d270d5a406.m' 3183/1744 bytes
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: stored 1 recipients, rc=0
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406 failed to store index data for id=8, errno=1064, append ret=0
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM sph_index WHERE id=8
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM rcpt WHERE id=8
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM metadata WHERE id=8
Aug 27 09:53:03 mailserver pilerimport[31395]: ERROR: 5000000066cd85e9073ed9cc00d270d5a406: rollback sql stmt=DELETE FROM attachment WHERE piler_id='5000000066cd85e9073ed9cc00d270d5a406'
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: unlinking /var/piler/store/00/66c/a4/06/5000000066cd85e9073ed9cc00d270d5a406.m
Aug 27 09:53:03 mailserver pilerimport[31395]: 5000000066cd85e9073ed9cc00d270d5a406: stored metadata, rc=1
Aug 27 09:53:03 mailserver pilerimport[31395]: server=mailserver.example.com, user=archive@mailserver.example.com, directory=(null), imported=0, duplicated=0, discarded=0

Expected behavior mail should be imported

Piler version:

• "piler -V" output

  
  piler 1.4.6, Janos SUTO <sj@acts.hu>

Build Date: Mon Aug 26 13:37:53 CEST 2024 ldd version: ldd (Debian GLIBC 2.36-9+deb12u7) 2.36 gcc version: gcc version 12.2.0 (Debian 12.2.0-14) OS: Linux mailserver 6.1.0-23-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.99-1 (2024-07-15) x86_64 GNU/Linux Configure command: ./configure --localstatedir=/var --with-database=mysql --enable-memcached MySQL client library version: 3.3.8 Extractors: /usr/bin/pdftotext /usr/bin/catdoc /usr/bin/catppt /usr/bin/xls2csv /usr/bin/unrtf /usr/bin/tnef libzip

[jsuto]

Can you format the log output? It's unreadable as it is currently.

[schickel007]

Comment edited

[jsuto]

Thank you. I suspect that the index settings are not in sync between manticore and piler. Check the rtindex settings in piler.conf, and the RT value in manticore.conf.

[schickel007]

Adapting RT value fixed this issue

thx