wb8tyw
commented
1 year ago What tool created this file?
D-Rats / Python 3 is assuming that all text files are Unicode UTF-8 encoded. By default unless special options are added, python will throw an exception when bytes that are illegal in UTF-8. We have tried to put the special options in place, but may have missed some in the conversion.
Before the adoption of UTF-8 for eight bit text use, there were alternate encodings that were used, Microsoft created a set of code pages for each locale, as the example in the trace "cp1252" and various other platforms use their own encodings, such as decmcs8 and iso*. These encodings can have 8 bit codes inside them that conflict with Unicode.
As neither Linux or Microsoft Windows track the actual encoding of text files, there is no way to auto-detect what conversion may be needed.
Python2 by default used code pages on Windows and one of the other platform specific settings.
Non UTF-8 text files with 8 bit characters in them will not display/render correctly on systems that use different non-unicode encoding.
KP4AJ
Hi: The error affects only Windows platform (latest code). Not a big deal pressing ignore is enough and the file get published but as error popup window shows, I am reporting it. I found this by accident when doing a random test. Maybe happens because one of the symbols at the text file. Situation as follows:
Ubuntu send ok receive ok Windows send error receive error (in receive however the file gets published at chat window) Windows 3.1 beta 5 send ok receive ok
Windows 10 (latest D-Rats code) Error when broadcasting: Traceback (most recent call last):
File "C:/Users/edfel/D-Rats/d_rats/ui/main_chat.py", line 876, in _bcast_file data = file_handle.read() ^^^^^^^^^^^^^^^^^^
File "C:/msys64/mingw64/lib/python3.11/encodings/cp1252.py", line 23, in decode return codecs.charmap_decode(input,self.errors,decoding_table)[0] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 1299: character maps to
Error when receiving same file (sent from Ubuntu) both machines latest D -Rats code: Traceback (most recent call last):
File "C:/Users/edfel/D-Rats/d_rats/mainapp.py", line 1303, in do_incoming self.mainwindow.tabs["chat"].display_line(line, incoming, color,
File "C:/Users/edfel/D-Rats/d_rats/ui/main_chat.py", line 632, in display_line self._display_line(line, incoming, "default", *attrs, **kwargs)
File "C:/Users/edfel/D-Rats/d_rats/ui/main_chat.py", line 773, in _display_line buffer.insert_with_tags_by_name(end, text + os.linesep, *tags)
File "C:/Users/edfel/D-Rats/d_rats/ui/main_chat.py", line 91, in insert_with_tags_by_name self.__logfile.write(text)
File "C:/msys64/mingw64/lib/python3.11/encodings/cp1252.py", line 19, in encode return codecs.charmap_encode(input,self.errors,encoding_table)[0] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeEncodeError: 'charmap' codec can't encode character '\u03a9' in position 525: character maps to
T-Branch.txt
Edfel KP4AJ