BK-SCOSS sctokenizer issues - Githubissues

BK-SCOSS / sctokenizer

A Source Code Tokenizer

MIT License

14 stars 5 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

tokenizers: use line length prefix sum instead of plain array

#16 ammen99 closed 3 weeks ago
1
':' is tokenized as an OPERATOR rather than a CONSTANT

#15 Derek-Jones opened 1 month ago
2
Incorrect processing of C/C++ escape-sequence in character constant

#14 Derek-Jones opened 1 month ago
2
Fix "__" not working at the start of identifiers

#13 id01 closed 7 months ago
1
Python and C tokenize misidentifies identifier

#12 gulaki opened 1 year ago
0
Java Tokenizer with carriage returns fails to tokenize

#11 LakshyAAAgrawal closed 1 month ago
1
Fix issue with /* */ comment cases in cpp_tokenizer.py

#10 xTrimy closed 2 years ago
2
Issue with /* */ comment cases in cpp_tokenizer.py

#9 Dec1mo closed 2 years ago
2
Fix issue in / symbol in cpp_tokenizer.py

#8 xTrimy closed 2 years ago
4
Thaidd/dev

#7 Dec1mo closed 3 years ago
0
Missing "/" operator in PHP tokenizer's result

#6 Dec1mo opened 3 years ago
9
Fix problems with #if, #ifdef and #ifndef in C/CPP

#5 Dec1mo closed 3 years ago
0
Problems with #if and #ifdef in C

#4 DieSchneegans closed 3 years ago
2
Fix \r\n endline ìninity loop

#3 ngocbh closed 4 years ago
0
Vientv/develop

#2 tranvien98 closed 4 years ago
0
add similarity

#1 tranvien98 closed 4 years ago
0