search

utk-se / WorldSyntaxTree

Language-agnostic parsing of World of Code repositories
Other
20 stars 0 forks source link

Add error marking to file objects #3

Open robobenklein opened 3 years ago

robobenklein commented 3 years ago

need to be able to mark files with error types on failure

  File "/home/robo/code/WorldSyntaxTree/venv/lib/python3.8/site-packages/WorldSyntaxTree-0.0.1-py3.8.egg/wsyntree_collector/mongo_collector.py", line 84, in _grow_nodes_by_file
    text=NodeText.get_or_create(cur_node.text.tobytes().decode()),
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd1 in position 216: invalid continuation byte