search

jeniyat / StackOverflowNER

Source Code and Data for Software Domain NER
MIT License
145 stars 37 forks source link

tokenization never stops #7

Open rayeya opened 3 years ago

rayeya commented 3 years ago

The tokenization never stops for some specific instances, for example: "it('should remove the elements domProps'), () => {" It may be caused by the catastrophic backtracking of Func_Name_Recursive regular expression.

jeniyat commented 3 years ago

We will look into it and update the code.

LGDDouble commented 2 years ago

I come across the same problem, is there any available solution?