Closed emmatyping closed 4 years ago
@pablogsal @gvanrossum Wouldn't this be solved by itself, once we integrate pegen into CPython?
Wouldn't this be solved by itself, once we integrate pegen into CPython?
Sort of, I think the problem is that this function call:
https://github.com/gvanrossum/pegen/blob/master/pegen/pegen.c#L607
is not taking the encoding at the moment. We can start hooking a call to PyTokenizer_FindEncodingFilename
there but that will likely change when integrating this into CPython so we could wait until then.
I'm sure this is fixed in the CPython version, and the version here is too outdated to care.
Minimal example:
The string constant is
"tu pense qu'on peut m'utiliser comme ça?"
with pegen.