language encoding issues in gae

[GoogleCodeExporter]

form on locally hosted aggregate server it will download fine with the correct 
characters encoding. downloading same form from gae aggregate it doesn't see 
the characters.

http://groups.google.com/group/opendatakit/t/1afdc12cde253ad2

Original issue reported on code.google.com by yanokwa on 3 Aug 2011 at 5:23

Attachments:

• TestingAmharic.xml

[GoogleCodeExporter]

I've identified two issues that combined to cause this on GAE.  

1) 
http://code.google.com/p/opendatakit/source/browse/src/main/java/org/opendatakit
/aggregate/form/Form.java?repo=aggregate&name=v1_0#366

should create the string as a UTF-8 encoding rather than the default system 
encoding (defaults are apparently different between GAE and a local Tomcat 
install).

2) upload code running on some browsers was doing a binary read of the xml 
instead of a utf-8 read.

Need to verify that these combined changes don't break Tomcat... .  

Original comment by mitchellsundt@gmail.com on 6 Aug 2011 at 12:35

[GoogleCodeExporter]

The fix in the v1_0 branch is 
http://code.google.com/p/opendatakit/source/detail?r=3499420205363cf0461c78afe1d
c4f914d43690b&name=v1_0&repo=aggregate

Changes required deleting the form and re-uploading it.  The database schema is 
unchanged.

Fix also applied to the uiExperiment branch.

Original comment by mitchellsundt@gmail.com on 8 Aug 2011 at 9:49

• Changed state: Fixed

[GoogleCodeExporter]

Updated the beta 3 installer (beta 3 utf-8) with this fix.

Original comment by mitchellsundt@gmail.com on 11 Aug 2011 at 8:02