Output of Unicode CJK characters are not displayed correctly

[GoogleCodeExporter]

What steps will reproduce the problem?
1. connects to a server whose output is produced by
ttyplay(http://0xcc.net/ttyrec/index.html.en).
2. ttyplay outputs CJK characters.
3.Soiled displays the outputs.

What is the expected output? What do you see instead?
I expect CJK characters are displayed correctly.
However I see garbage characters.

What version of the product are you using? On what operating system? With
what browser? Which version of the Flash Player?
I used 0.44 and svn trunk.
On Ubuntu 8.
With firefox 3.0.14.
Flash Player 10.

Please provide any additional information below.
Non-CJK outputs are displayed very well.

Original issue reported on code.google.com by kariya1...@gmail.com on 30 Oct 2009 at 10:41

[GoogleCodeExporter]

Sorry for the late response, I didn't get notified about this issue by the 
system... 

First of all, Soiled currently only supports ASCII, ISO-8859-1 and UTF-8 
character encodings, so if the server 
doesn't use any of them, it is the expected behaviour (but in that case please 
file a bug report about what 
encoding you need and I might add it).

If the server uses UTF-8, how does it switch to UTF-8? Does it use the TELNET 
CHARSET option negotiation or 
does it send ESC % G ?

Original comment by bofh69 on 18 Nov 2009 at 2:01

[GoogleCodeExporter]

Thank you for the response.
The server uses UTF-8 characters.
I know neither the way of switching characters nor how to examine it,
but as far as I see binary data produced by the server,
there is nothing special such as "TELNET CHARSET" and "ESC % G".
I'm not sure but just guess that UTF-8 characters are directly injected into the
output stream.
If you have further examination procedure, please let me know.

Original comment by kariya1...@gmail.com on 26 Nov 2009 at 7:38

[GoogleCodeExporter]

Can you attach a short ttyrecord file that shows the problem or point me to a 
server 
where it is servered?

It might be that the server doesn't switch to UTF-8, but expects that the 
client is 
expecting UTF-8 from the beginning. That is really an incorrect behavior of the 
server, 
but I'll add an parameter to Soiled to force it into UTF-8 mode from the 
beginning.

Original comment by bofh69 on 26 Nov 2009 at 7:51

[GoogleCodeExporter]

I've added the parameter "charset" to soiled (in trunk) and updated its html 
page to have examples of using it to 
force soiled to use utf-8 from the beginning.
Please try that and let me know how it goes.

Original comment by bofh69 on 1 Dec 2009 at 5:01

[GoogleCodeExporter]

Thanks a lot (and sorry for my late response).

I tried the trunk with the "charset" parameter 
and found CJK characters displayed well.

Original comment by kariya1...@gmail.com on 10 Dec 2009 at 4:21

[GoogleCodeExporter]

Great! I'll close this report then.

Original comment by bofh69 on 13 Jan 2010 at 1:44

• Changed state: Verified