search

IATI / ckanext-iati

CKAN extension for the IATI Registry
http://iatiregistry.org
9 stars 6 forks source link

CSV Upload results in Internal Server Error when special characters are used #391

Open andreaszenasidi opened 2 years ago

andreaszenasidi commented 2 years ago

Brief Description The Registry CSV Upload results in Internal Server Error when special characters such as ô are used.

Severity Low

Issue Location https://iatiregistry.org/csv/upload

Steps to Reproduce Add a list of actions needed to replicate the error. Steps to reproduce the behavior:

  1. Go to CSV Import
  2. Upload a file that has a row with title Côte d'Ivoire
  3. Click Upload to upload the CSV file
  4. See error displayed: Internal Server Error

Expected Results/Behaviour

  1. The CSV Upload should accept special characters such as ô, ó, ä, ü, à
  2. If an unacceptable character is detected, the Registry should display the following error message "Invalid character detected in the CSV file."

Actual Results/Behaviour If a special character is used, an Internal Server Error is displayed to the user. image

ADDITIONAL QUESTION: what encoding is accepted by the upload service?

Bjwebb commented 11 months ago

Would should accept utf-8. Related is this issue about supporting a BOM https://github.com/IATI/ckanext-iati/issues/306