kamahen / pykythe

Generate code Python source cross-reference facts in Kythe format
Other
21 stars 3 forks source link

UTF8 coding error message leaks #30

Open kamahen opened 4 years ago

kamahen commented 4 years ago

This appears to be from /home/peter/src/pytype/cpython/Lib/msilib/__init__.py (which is a submodule of a submodule of pytype). These error messages seem to be produced at a lower level (lib2to3? - except that would imply Python logger pykythe isn't being used):

Warning: /tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.pykythe.batch-bbb:2:
Warning:    '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py':480:0: Illegal UTF-8 continuation
Warning: /tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.pykythe.symtab:2:
Warning:    '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py':480:0: Illegal UTF-8 continuation
 204.597: Cannot reuse cache (different source) '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpyth
 204.121: Start /home/peter/src/pytype/cpython/Lib/msilib/__init__.py
 204.122: Processing from source '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' (output: '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.kythe.json') for '.home.peter.src.pytype.cpython.Lib.msilib' [atoms:28254,cputime:202.787160571,globalused:1474640,localused:2360,trail:67110888,stack:209854400]
 204.125: Python parser: finished parsing/fqn (0.41 sec) into '/tmp/pykythe_test/KYTHE/swipl_17119_259.fqn-ast.pl'
 204.126: Processed AST nodes from Python parser
 204.128: Pass 1: process nodes for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:28453,cputime:202.79280613,globalused:1766040,localused:2360,trail:67110888,stack:209854400]
 204.128: Pass 2: process exprs for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:28454,cputime:202.792836341,globalused:1766712,localused:2536,trail:67110888,stack:209854400]
 204.128: Process exprs: Pass 1 (rej=0) for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.128: MESSAGE astn(0,17605,-msg-): Parse error ... bad input: type=3, value='"%s.%s unknown bits %x"', context=(' ', (49, 22)) (type=3) value='"%s.%s unknown bits %x"' context:(' ', (49, 22)) file:'/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.129: Pass 3a: output for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:28463,cputime:202.793468415,globalused:1774392,localused:2288,trail:67110888,stack:209854400]
 204.136: Writing Kythe facts for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.223: Converting to Kythe protobuf
 204.225: Finished output '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' ('.home.peter.src.pytype.cpython.Lib.msilib') to '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.kythe.entries' ('/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.kythe.json')
 204.225: Pass 3b: output for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:28491,cputime:202.890242482,globalused:734664,localused:2288,trail:67110888,stack:209854400]
 204.225: Start /home/peter/src/pytype/cpython/Lib/msilib/schema.py
 204.226: Processing from source '/home/peter/src/pytype/cpython/Lib/msilib/schema.py' (output: '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/schema.kythe.json') for '.home.peter.src.pytype.cpython.Lib.msilib.schema' [atoms:28495,cputime:202.891100203,globalused:1475504,localused:2360,trail:67110888,stack:209854400]
 204.229: Python parser: finished parsing/fqn (4.75 sec) into '/tmp/pykythe_test/KYTHE/swipl_17119_263.fqn-ast.pl'
 204.400: Processed AST nodes from Python parser
 204.596: Pass 1: process nodes for '/home/peter/src/pytype/cpython/Lib/msilib/schema.py' [atoms:51671,cputime:203.238719624,globalused:27532752,localused:3228432,trail:67110888,stack:209854400]
Warning: /tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.pykythe.batch-bbb:2:
Warning:    '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py':480:0: Illegal UTF-8 continuation
 204.596: Cannot reuse cache (different source) '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.pykythe.batch-bbb' for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
Warning: /tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.pykythe.symtab:2:
Warning:    '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py':480:0: Illegal UTF-8 continuation
 204.597: Cannot reuse cache (different source) '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.pykythe.symtab' for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.597: Processing from source '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' (output: '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.kythe.json') for '.home.peter.src.pytype.cpython.Lib.msilib' [atoms:51679,cputime:203.240313113,globalused:27681560,localused:3228984,trail:67110888,stack:209854400]
 204.600: Python parser: finished parsing/fqn (0.31 sec) into '/tmp/pykythe_test/KYTHE/swipl_17119_264.fqn-ast.pl'
 204.601: Processed AST nodes from Python parser
 204.603: Pass 1: process nodes for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:51873,cputime:203.246300357,globalused:27979080,localused:3228984,trail:67110888,stack:209854400]
 204.603: Pass 2: process exprs for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:51873,cputime:203.24632796,globalused:27979752,localused:3229160,trail:67110888,stack:209854400]
 204.604: Process exprs: Pass 1 (rej=0) for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.604: MESSAGE astn(0,17605,-msg-): Parse error ... bad input: type=3, value='"%s.%s unknown bits %x"', context=(' ', (49, 22)) (type=3) value='"%s.%s unknown bits %x"' context:(' ', (49, 22)) file:'/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.604: Pass 3a: output for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:51881,cputime:203.246941296,globalused:27987432,localused:3228912,trail:67110888,stack:209854400]
 204.613: Writing Kythe facts for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py'
 204.734: Converting to Kythe protobuf
 204.737: Finished output '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' ('.home.peter.src.pytype.cpython.Lib.msilib') to '/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.kythe.entries' ('/tmp/pykythe_test/KYTHE/home/peter/src/pytype/cpython/Lib/msilib/__init__.kythe.json')
 204.737: Pass 3b: output for '/home/peter/src/pytype/cpython/Lib/msilib/__init__.py' [atoms:52235,cputime:203.379797654,globalused:51480168,localused:3228912,trail:67110888,stack:209854400]