mlsecproject / combine

Tool to gather Threat Intelligence indicators from publicly available sources
https://www.mlsecproject.org/
GNU General Public License v3.0
653 stars 179 forks source link

UnicodeDecodeError in winnower #55

Closed krmaxwell closed 9 years ago

krmaxwell commented 10 years ago
Dumping results
Traceback (most recent call last):
  File "winnower.py", line 150, in <module>
    winnow('crop.json', 'crop.json', 'enriched.json')
  File "winnower.py", line 146, in winnow
    json.dump(enriched, f, indent=2)
  File "/usr/lib/python2.7/json/__init__.py", line 189, in dump
    for chunk in iterable:
  File "/usr/lib/python2.7/json/encoder.py", line 431, in _iterencode
    for chunk in _iterencode_list(o, _current_indent_level):
  File "/usr/lib/python2.7/json/encoder.py", line 332, in _iterencode_list
    for chunk in chunks:
  File "/usr/lib/python2.7/json/encoder.py", line 332, in _iterencode_list
    for chunk in chunks:
  File "/usr/lib/python2.7/json/encoder.py", line 313, in _iterencode_list
    yield buf + _encoder(value)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xe7 in position 22: invalid continuation byte
krmaxwell commented 10 years ago

relevant:

kirk-unicode

alexcpsec commented 9 years ago

Being tracked on #104 and #103