9853772 / go-charset

Automatically exported from code.google.com/p/go-charset
0 stars 0 forks source link

big5 to utf-8 conversion erases ASCII characters (a-zA-Z0-9, etc) #9

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago
What steps will reproduce the problem?
1. import go-charset with both charset and charset/data package
2. perform conversion on a string containing ASCII characters
3. check the result

What is the expected output? 
The ASCII characters should be there with the converted big5 characters.

What do you see instead?
The ASCII characters disappeared.

What version of the product are you using? On what operating system?
go1.1.1 on Windows XP without iconv

Please provide any additional information below.

Example (runnable example attached):
r, err := charset.NewReader("big5", strings.NewReader("123 English 
\xb4\xfa\xb8\xd5"))
if err != nil {
    log.Fatal(err)
}
result, err := ioutil.ReadAll(r)
if err != nil {
    log.Fatal(err)
}
fmt.Printf("%s\n", result)

Original issue reported on code.google.com by Benny.T...@gmail.com on 2 Jul 2013 at 11:02

Attachments: