cedricrupb code_tokenize issues - Githubissues

cedricrupb / code_tokenize

Fast tokenization and structural analysis of any programming language

MIT License

43 stars 8 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Unexpectedly recent/incompatible version of tree-sitter

#6 penguinland opened 2 days ago
2
Unexpected token with no matched text at the end of tokenstream

#5 LakshyAAAgrawal opened 1 year ago
4
string literals lost during tokenization for C/C++ code.

#4 5c4lar opened 2 years ago
2
code_tokenize v0.2.0: Major API redesign

#3 cedricrupb closed 2 years ago
0
The tree-sitter-go can not parse the type of string.

#2 GoneZ5 closed 2 years ago
2
Could this tool parse a part of C code?

#1 BodyCSoulN closed 2 years ago
2