PyShell or IPyShell problem of encoding

[GoogleCodeExporter]

What steps will reproduce the problem?
1.Type '啊' u'啊' or print these.
2.a='啊';b=a.decode('mbcs')
Type codes like those above will make the program CPU 100%.

What is the expected output? What do you see instead?

---

IMPORTANT!!! Please answer these questions for any and ALL bug reports

What version of the product are you using? On what operating system?
Editra 0.3.0
WindowXP

What method of install was your version installed with (Binary/Source)?
Source

Please provide any additional information below.
When I use an old version of Editra (version 0.2.X).The plugin manager
cannot install the plugins correctly.And the it doesn't tell me the plugin
needs a new version Editra.It downloads and installs the plugin,but it do
not appear in the list.

Original issue reported on code.google.com by yangwei...@gmail.com on 28 May 2008 at 6:28

[GoogleCodeExporter]

Hello, do you have any idea how i can reproduce this behaviour with azerty 
keyboard?

Original comment by laurent....@gmail.com on 28 May 2008 at 9:41

[GoogleCodeExporter]

You could either copy and paste the character in, or use an IME (input method
editor). On windows it can be enabled in the Language Settings by adding 
support for
Japanese or Chinese, ect.. to your windows installation.

I however believe this is an issue with the StyledTextCtrl (Scintilla). The 
version
that is in wxPython2.8 has some issues with double byte width characters and 
how it
stores the data for the display. So don't worry about this one I will look into 
it.

Cody

Original comment by CodyPrec...@gmail.com on 28 May 2008 at 9:55

• Changed state: Investigate

[GoogleCodeExporter]

You can look at the Ulipad,another python editor written in wxPython.It 
supports wide
char language very good.Because the author is Chinese.
http://code.google.com/p/ulipad/

Original comment by yangwei...@gmail.com on 29 May 2008 at 2:37

[GoogleCodeExporter]

Hello,

I finally got a chance to look at this and am unable to reproduce this issue.

What version of wxPython do you have installed? Is it the Unicode version or 
Ansi (I
only work/test on the Unicode one)?

Thanks,

Cody

P.S also the issue with the plugin manager, this is a known issue. Editra is 
still
under fairly rapid development and I don't do much for backwards compatibility 
at
this time. I have been meaning to add warning of incompatible plugins though, 
so feel
free to report it in a separate bug report.

Original comment by CodyPrec...@gmail.com on 10 Jun 2008 at 12:39

[GoogleCodeExporter]

Original comment by CodyPrec...@gmail.com on 10 Jun 2008 at 12:41

• Changed state: Pending

[GoogleCodeExporter]

I use wxPython2.8 unicode and Simplfied Chinese WindowsXP.
I think you may try to set the "the language for none-unicode program"(I don't 
the
correct English name because my windows is Chinese) to "Chinese(China P.R.C)" in
Control Panel.
p.s. The "Launcher" plugin also has encoding problem.If the output text is not
correctly encoded, the '\n' end of line will not function.

Original comment by yangwei...@gmail.com on 12 Jun 2008 at 5:35

[GoogleCodeExporter]

In IPyShell,it report an error.
#---- Notes ----#
Please provide additional information about the crash here

#---- System Information ----#
Editra Version: 0.3.0
Operating System: Windows XP (build 2600, Service Pack 2)
Python Version: 2.5.1 (r251:54863, Apr 18 2007, 08:51:08) [MSC v.1310 32 bit 
(Intel)]
wxPython Version: 2.8.7.1 (msw-unicode)
wxPython Info: (__WXMSW__, wxMSW, unicode, wx-assertions-on, SWIG-1.3.29)
Python Encoding: Default=ascii  File=mbcs
wxPython Encoding: cp936
System Architecture: 32bit 
Byte order: little
Frozen: False
#---- End System Information ----#
#---- Runtime Variables ----#
AALIASING=False
ALPHA=255
APPSPLASH=True
AUTO_COMP=True
AUTO_INDENT=True
BRACKETHL=True
BSUNINDENT=True
CHECKMOD=True
CHECKUPDATE=True
CODE_FOLD=True
DEFAULT=False
DEFAULT_LEX=Python
DEFAULT_VIEW=Automatic
EDGE=80
EOL=Windows (\r\n)
FFILTER=0
FHIST_LVL=9
FONT1=Courier New,10
FONT2=Arial,10
GUIDES=False
HLCARETLINE=False
ICONS=Tango
ICON_SZ=(24, 24)
INDENTWIDTH=4
IPython.background_color=BLACK
IPython.completion=IPYTHON
KEY_PROFILE=None
LANG=English (U.S.)
LASTCHECK=2041
Launch.Config={'pike': ('pike', [('pike', 'pike')]), 'ferite': ('ferite', 
[('ferite',
'ferite')]), 'nsis': ('makensis', [('makensis', 'makensis')]), 'python': 
(u'python',
[(u'pylint', u'pylint'), (u'python', u'D:\\python25\\python')]), 'lua': ('lua',
[('lua', 'lua'), ('luac', 'luac')]), 'ada': ('gcc -c', [('gcc -c', 'gcc -c')]),
'tcl/tk': ('wish', [('wish', 'wish')]), 'perl': ('perl', [('perl', 'perl')]),
'postscript': ('gs2in32c', [('gswin32c', 'gswin32c')]), 'c shell': ('csh', 
[('csh',
'csh')]), 'handler': ('', []), 'boo': ('booi', [('booi', 'booi')]), 'haskell': 
('ghc
--make', [('ghc --make', 'ghc --make')]), 'php': ('php', [('php', 'php -f')]),
'ruby': ('ruby', [('ruby', 'ruby')]), 'korn shell': ('ksh', [('ksh', 'ksh')]), 
'bash
shell': ('bash', [('bash', 'bash')]), 'haxe': ('nekoc', [('neko', 'neko'), 
('nekoc',
'nekoc')])}
MAXIMIZED=False
MODE=CODE
MYPROFILE=C:\Documents and Settings\Administrator\.Editra\profiles\default.ppb
OPEN_NW=False
PRINT_MODE=BLACK/WHITE
REPORTER=True
SAVE_POS=True
SAVE_SESSION=False
SET_WPOS=True
SET_WSIZE=True
SHELF_ITEMS=[u'Editra Log', u'Launch', u'IPyShell']
SHOW_EDGE=True
SHOW_EOL=False
SHOW_FB=True
SHOW_LN=True
SHOW_WS=False
SYNTAX=True
SYNTHEME=Default
TABWIDTH=4
THEME=DEFAULT
TOOLBAR=True
USETABS=True
VI_EMU=False
WPOS=(0, 52)
WRAP=False
WSIZE=(1160, 812)
FTYPES=[u'py', u'txt']
#---- End Runtime Variables ----#

#---- Traceback Info ----#
*** Thu Jun 12 13:38:16 2008 ***
Traceback (most recent call last):
  File "c:\documents and
settings\administrator\.editra\plugins\ipyshell-0.3-py2.5.egg\IPython\gui\wx\ipy
thon_view.py",
line 717, in keyPress
    self.stateDoExecuteLine()
  File "c:\documents and
settings\administrator\.editra\plugins\ipyshell-0.3-py2.5.egg\IPython\gui\wx\ipy
thon_view.py",
line 611, in stateDoExecuteLine
    self.IP.doExecute(lines_to_execute.encode('cp1252'))
  File "D:\Python25\lib\encodings\cp1252.py", line 12, in encode
    return codecs.charmap_encode(input,errors,encoding_table)
UnicodeEncodeError: 'charmap' codec can't encode character u'\u554a' in 
position 1:
character maps to <undefined>

#---- End Traceback Info ----#

Original comment by yangwei...@gmail.com on 12 Jun 2008 at 5:54

[GoogleCodeExporter]

Made some changes to the Ipython code to better guess the systems encoding when
encoding strings.

Hopefully this will fix it for the next release.

Original comment by CodyPrec...@gmail.com on 16 Aug 2008 at 2:16

• Changed state: Fixed

[GoogleCodeExporter]

cleaning up old 'fixed' issues

Original comment by CodyPrec...@gmail.com on 3 Feb 2009 at 6:41

• Changed state: Verified