collective / collective.recipe.solrinstance

Buildout recipe to configure a Solr instance
https://pypi.python.org/pypi/collective.recipe.solrinstance
5 stars 13 forks source link

Templating doesn't support unicode #29

Closed skillfully closed 10 years ago

skillfully commented 10 years ago

Creating stopwords file from template with german umlauts throws an UnicodeEncodeError.

davidjb commented 10 years ago

Can you provide a traceback? That'd help pin-pointing where the error is coming from.

skillfully commented 10 years ago

-- snip -- An internal error occured due to a bug in either zc.buildout or in a recipe being used: Traceback (most recent call last): File "/home/user/Plone/buildout-cache/eggs/zc.buildout-1.4.4-py2.6.egg/zc/buildout/buildout.py", line 1683, in main getattr(buildout, command)(args) File "/home/user/Plone/buildout-cache/eggs/zc.buildout-1.4.4-py2.6.egg/zc/buildout/buildout.py", line 555, in install installed_files = self[part]._call(recipe.install) File "/home/user/Plone/buildout-cache/eggs/zc.buildout-1.4.4-py2.6.egg/zc/buildout/buildout.py", line 1227, in _call return f() File "/home/user/Plone/buildout-cache/eggs/collective.recipe.solrinstance-5.3.1-py2.6.egg/collective/recipe/solrinstance/init.py", line 636, in install default_config_destination), File "/home/user/Plone/buildout-cache/eggs/collective.recipe.solrinstance-5.3.1-py2.6.egg/collective/recipe/solrinstance/init.py", line 477, in generate_stopwords name='stopwords.txt', kwargs) File "/home/user/Plone/buildout-cache/eggs/collective.recipe.solrinstance-5.3.1-py2.6.egg/collective/recipe/solrinstance/init**.py", line 438, in _generate_from_template outfile.write(output) UnicodeEncodeError: 'ascii' codec can't encode character u'\xdf' in position 380: ordinal not in range(128) -- snap --

it's the same issue like https://github.com/hannosch/collective.recipe.solrinstance/issues/3

davidjb commented 10 years ago

This should now be sorted - the template writer encodes anything getting written out as utf-8 prior to output, so this should handle any Unicode characters. Tested with Solr 4.9 and appears Solr reads all files with UTF-8 without issue.