bblfsh / python-driver

GNU General Public License v3.0
10 stars 16 forks source link

'unicodeescape' codec can't decode bytes #204

Open ncordon opened 5 years ago

ncordon commented 5 years ago

We are getting the following error in the latest bblfsh logs:

rpc error: code = Internal desc = Traceback (most recent call last):\n
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/requestprocessor.py\", line 155, in process_request\n    ast = AstImprover(code, orig_ast).parse()\n 
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 39, in parse\n    res = self.visit(self._astdict, root=True)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 66, in visit\n    visit_result = meth(node)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 264, in visit_other\n    node[field] = meth(child)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 271, in visit_other_field\n    return [self.visit(x) for x in node]\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 271, in <listcomp>\n    return [self.visit(x) for x in node]\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 66, in visit\n    visit_result = meth(node)\n 
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 264, in visit_other\n    node[field] = meth(child)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 271, in visit_other_field\n    return [self.visit(x) for x in node]\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 271, in <listcomp>\n    return [self.visit(x) for x in node]\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 66, in visit\n    visit_result = meth(node)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 264, in visit_other\n    node[field] = meth(child)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 269, in visit_other_field\n    return self.visit(node)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/astimprove.py\", line 68, in visit\n    self.pos_sync.sync_node_pos(visit_result)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/locationfixer.py\", line 78, in sync_node_pos\n    token = self._pop_token(node_line, node_token)\n  
File \"/opt/driver/bin/.local/lib/python3.6/site-packages/python_driver/locationfixer.py\", line 41, in _pop_token\n    line_value = literal_eval(t.value)\n  
File \"/usr/local/lib/python3.6/ast.py\", line 48, in literal_eval\n    node_or_string = parse(node_or_string, mode='eval')\n  
File \"/usr/local/lib/python3.6/ast.py\", line 35, in parse\n    return compile(source, filename, mode, PyCF_ONLY_AST)\n  
File \"<unknown>\", line 6\nSyntaxError: (unicode error) 'unicodeescape' codec can't decode bytes in position 106-107: truncated \\uXXXX escape\n
Files that produce the error ``` python/samba/netcmd/common.py Lib/idlelib/WidgetRedirector.py components/org.apache.stratos.python.cartridge.agent/cartridgeagent/cartridgeagent/modules/databridge/thrift/thrift/protocol/TJSONProtocol.py lib-python/2.4.1/test/test_codeccallbacks.py BaseTools/Source/Python/Eot/InfParserLite.py vendor/github.com/elastic/beats/topbeat/tests/system/test_procs.py lib/cuckoo/common/peepdf/JSAnalysis.py Doc/tools/anno-api.py Lib/test/test_unicodedata.py Lib/test/test_codeccallbacks.py Lib/test/test_parser.py tools/RosBE/RosBE-PPC/pyhive/mkhive.py Tools/idle/WidgetRedirector.py lib/lyx2lyx/lyx_1_2.py AppPkg/Applications/Python/Python-2.7.2/Lib/test/test_parser.py AppPkg/Applications/Python/Python-2.7.2/Lib/test/test_ucn.py AppPkg/Applications/Python/Python-2.7.10/Lib/json/encoder.py src/pal/automation/compile.py AppPkg/Applications/Python/Python-2.7.2/Lib/test/test_codeccallbacks.py conf.py Lib/test/test_ucn.py trunk/doc/pfc/scripts/urls2tex.py trunk/doc/es/pfc/scripts/urls2tex.py AppPkg/Applications/Python/Python-2.7.10/Lib/json/__init__.py BaseTools/Source/Python/AutoGen/UniClassObject.py AppPkg/Applications/Python/Python-2.7.2/Lib/test/test_unicodedata.py ```