coddingtonbear / django-mailbox

Import mail from POP3, IMAP, local email mailboxes or directly from Postfix or Exim4 into your Django application automatically.
MIT License
356 stars 164 forks source link

LookupError: unknown encoding: _iso-2022-jp$esc #34

Closed mounirmesselmeni closed 9 years ago

mounirmesselmeni commented 9 years ago
Traceback (most recent call last):
  File "./manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django/core/management/__init__.py", line 385, in execute_from_command_line
    utility.execute()
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django/core/management/__init__.py", line 377, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django/core/management/base.py", line 288, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django/core/management/base.py", line 338, in execute
    output = self.handle(*args, **options)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django_mailbox/management/commands/getmail.py", line 24, in handle
    messages = mailbox.get_new_mail()
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django_mailbox/models.py", line 342, in get_new_mail
    msg = self.process_incoming_message(message)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django_mailbox/models.py", line 225, in process_incoming_message
    msg = self._process_message(message)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django_mailbox/models.py", line 324, in _process_message
    message = self._get_dehydrated_message(message, msg)
  File "/home/mounir/Devel/document_search_env/lib/python2.7/site-packages/django_mailbox/models.py", line 301, in _get_dehydrated_message
    msg.get_payload(decode=True).decode(content_charset)
LookupError: unknown encoding: _iso-2022-jp$esc
coddingtonbear commented 9 years ago

Interesting! So, although Python would've been able to decode iso-2022-jp without any problems, I'm not totally sure what _iso-2022-jp$esc is and wonder if the encoding differs. Could I convince you into attaching the message payload so I could add it in a test verifying the fix for this issue?

mounirmesselmeni commented 9 years ago

msg.as_string() 'X-Apparently-To: elmes_gl@yahoo.fr via 188.125.68.244;\n Mon, 27 Oct 2014 02:12:28 +0000\nX-YahooFilteredBulk: 198.50.119.114\nReceived-SPF: permerror (encountered permanent error during SPF processing of\n domain of khas.edu.tr)\nX-YMailISG: CRNdlvkWLDsFX.jV8Wf5pFy1W2dSIs8qNdqbunslWRoqItLo\n 47fw7m_mvlsFZf7DEf3bVDL7AQ7s_w8R3ob1j0vEFbnqzryVAqCK0ulBybFN\n byY979DrvOq5s53C8BBTDV8sD5jMcPwhGFC16gLmmvq7KNQv2yOPQwRWMkWa\n OxEwq96xpn7IDaRorZnqliUwy_A6sVDuB_lbCW63vVNcZ97A7XbMBI2TQzq5\n s.cmoyJ7K3zMaYhpvHWIRwboHX4s9fivwsUX7nCRZg5iIeJBW_G57pUt66sL\n 5uouwfU8cU4gH6AxHk2V8p991zHezl2dDIXHtM.Ytqmt7TqU05hn1.5JtYWY\n COTlCjrwjAqFO7sODv9udn86wicpyBGfz4YojjmpjDSLgb1fIR4ohkKJwoa9\n t6QfjOKB8LngYAFWM1EdrBeRzRTiVMoLlIOimqFeZWu_bWiYzek12i54wzFw\n LEBj39SOBWx8vjfqN7jrYw7KN6o4ikO2OsjKT5d5rr2lXgy0VXJiZHKMAE2M\n ROT8c3e_rwCSD3.8ECNmeWT.8UlmXaPoPNkGCqyiqfefsIKLwkTSAL9pHdKS\n fKbeEqd1_tFHqeYlXkCbFZHkDlNYVEd5h.xLP8ANpjCsMoGwvnVHHsNN2gew\n zIXhyR3kISkMKgj8Nq7o5knYh5jOot3x4SlRl.Vk9CKgKDGeWNfJ3IhtJHnN\n 89HPlJgaiTi5dTB6LMvYK3FTKjxT.ZT6KNV0lFDQemPQ.0v0f_WsXHtVrEiu\n 07eXQcPXgdQ_Qt9tquvfnAq_ZnoF8TtJZgf7rfJrRR3WuW6E_oSVdGT8f7iS\n OK0cOTi.Xc2W7Ru3HLgf4SHPGlQS39cUE5Rowi.1zIMGXPuoRjC0rEYSsmCE\n U2v3jz_24k8_h8RCOcUV4aYdB.5DA8Axt7pwKyAf.Um1eb.cagWDbMIVovLX\n lzyuI9POJfjx4unWV4SKvWWSojd7C5d6G26UpMPPvo07j_Lu2Z9le1w6GgCP\n lS1ZFzFOyG.zwoq8QV8IpD3AOHs3CjoFZfxNfv94O_3VrqCIndTeVLgDB95d\n v5C5rs8S2sCTTDcGjyEUfbaL3TgNA.cYzdYOfi15nbVaQHjmZbqB..t3x79x\n A6yTni2UR4AKqGgaCFVf2ugACsArFjqPM6_NegQ3rZFrWIb7vy.PDHNCz8jc\n NmnIBZRendmNlX2pIw21gh73_KHNfopebw63ofAtfL9L4Y0UCSM.AvrZCa8K\n k5fOADYrIsTg0kvepmpD8SGlZON.SCaSDp6Ga0ivQv0.FG.mTIr_mWDi7X7Q\n 07ftLO6lSnFOUgOdLv5NrG8HDs1AEt6jE6FL1F5KxED1Tz803dCbsvErc9h_\n em4Ar21On.zHOnsFC2JOTwCSqGNTCtBvk7nieTyVCO3Insr_9q1Dj.9T._am\n iXrFRgpdsQT9UwD7hjDvOmMZOyf2YqVWaEKgHKFAhhd4Ezc-\nX-Originating-IP: [198.50.119.114]\nAuthentication-Results: mta1103.mail.ir2.yahoo.com from=khas.edu.tr;\n domainkeys=neutral (no sig); from=khas.edu.tr; dkim=neutral (no sig)\nReceived: from 127.0.0.1 (EHLO sit.mexsitios.com.mx) (198.50.119.114)\n by mta1103.mail.ir2.yahoo.com with SMTPS; Mon, 27 Oct 2014 02:12:27 +0000\nReceived: from [41.138.162.236] (port=59864 helo=User)\n by sit.mexsitios.com.mx with esmtpa (Exim 4.82)\n (envelope-from <finance@khas.edu.tr>)\n id 1Xfo2k-00048o-FB; Sun, 19 Oct 2014 06:48:59 -0400\nReply-To: <private00@qq.com>\nFrom: "Refinance"<finance@khas.edu.tr>\nSubject: Apply For Loans @ 2% Per Annum\nDate: Sun, 19 Oct 2014 11:48:49 +0100\nMIME-Version: 1.0\nContent-Type: text/plain;\r\n\tcharset="_iso-2022-jp$ESC"\nContent-Transfer-Encoding: 7bit\nX-Priority: 3\nX-MSMail-Priority: Normal\nX-Mailer: Microsoft Outlook Express 6.00.2800.1081\nX-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1081\nX-AntiAbuse: This header was added to track abuse,\n please include it with any abuse report\nX-AntiAbuse: Primary Hostname - sit.mexsitios.com.mx\nX-AntiAbuse: Original Domain - yahoo.fr\nX-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]\nX-AntiAbuse: Sender Address Domain - khas.edu.tr\nX-Get-Message-Sender-Via: sit.mexsitios.com.mx: authenticated_id:\n aachem@unimex.com.mx\n\nWe offer loans to private individuals and corporate organizations at 2% interest rate. Interested serious applicants should apply via email with details of their requirements.\r\n\r\n\r\n\r\n\r\n\r\nWarm Regards,\r\nLoan Team'

msg.get_params() [('text/plain', ''), ('charset', '_iso-2022-jp$ESC')]

msg.get_payload() 'We offer loans to private individuals and corporate organizations at 2% interest rate. Interested serious applicants should apply via email with details of their requirements.\r\n\r\n\r\n\r\n\r\n\r\nWarm Regards,\r\nLoan Team'

coddingtonbear commented 9 years ago

Fixed via aa59199! Thanks for the heads up, @MounirMesselmeni :heart:

mounirmesselmeni commented 9 years ago

@coddingtonbear That's me who must thank you for your great contribute and reactivity !