utf-16 file import does not work

[GoogleCodeExporter]

What steps will reproduce the problem?
1. create a excel doc with chinese, pinyin, etc characters
2. save as unicode utf-16 text file (the file is tab separated and uses
double quotes as times, may need some massaging) 
3. try to import file into sqlite 
4. Stops working, i used textwranger to convert it to utf-8 it works fine. 

What is the expected output? 

Does not import utf-16, only utf-8 please implement this import function as
most of us work with excel. Thanks. 

What do you see instead?

data would not import 

Extension Version = Sqlite manager 0.4.5
Application = Firefox 3.07
OS = Mac OS X 10.5.6

Original issue reported on code.google.com by lec...@gmail.com on 17 Mar 2009 at 4:57

[GoogleCodeExporter]

Could u pls attach a sample utf-16 file here?

Original comment by mrinal.k...@gmail.com on 17 Mar 2009 at 6:38

• Added labels: Type-Defect

[GoogleCodeExporter]

I tried it even with numbers it is a problem. Not just text, here are 2 samples.
Short, I did not want to give away my data, but you can dup them. 

Original comment by lec...@gmail.com on 17 Mar 2009 at 1:33

Attachments:

• Workbook1_utf16.txt
• Workbook1_utf8.txt
• Workbook2_utf16.txt
• Workbook1_utf8.txt

[GoogleCodeExporter]

Thanks for the files. I think this issue has been fixed. But it would be nice 
to have
it confirmed. Version 0.4.7 fixes it. Can u pls confrm the same using the latest
version available on downloads page.

Fix: When importing, user can specify that the file to import is UTF-16 instead 
of
the default UTF-8.

Original comment by mrinal.k...@gmail.com on 18 Mar 2009 at 11:06

• Changed state: Fixed
• Added labels: Milestone-Release_0.4.7

[GoogleCodeExporter]

Thanks for the fix, that was very quick and very cool, my dev team will be very
happy. Very much appreciate it! 

I tested it with my  more comprehensive data set 500 records consisting of 3
different scripts (text and numbers). I saved my excel table doc as Unicode 
UTF-16
txt file and wonderful we are in business. If anyone else is doing this, use tab
separated when importing. 

Original comment by lec...@gmail.com on 18 Mar 2009 at 11:37