poldracklab / open_fmri

Reimplementation of OpenfMRI.org in Django
BSD 3-Clause "New" or "Revised" License
5 stars 5 forks source link

ds000203 contains README which is not a proper UTF-8 encoded file #39

Open yarikoptic opened 7 years ago

yarikoptic commented 7 years ago
(git)smaug:/mnt/btrfs/datasets-dev-20161125/datalad/crawl/openfmri/ds000203[master]git
$> isutf8 README 
README: line 7, char 1, byte offset 38: invalid UTF-8 code

$> python -c "from io import open; s=open('README', encoding='utf-8').read().strip(); print(type(s)); print(s)"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/yoh/proj/datalad/datalad/venv-tests/lib/python2.7/codecs.py", line 296, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xf1 in position 253: invalid continuation byte