search

sugarme / tokenizer

NLP tokenizers written in Go language
Apache License 2.0
182 stars 28 forks source link

regexp dont support ?i #43

Open xuxiaoxia96 opened 3 months ago

xuxiaoxia96 commented 3 months ago

panic: regexp: Compile("(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\r\n\p{L}\p{N}]?\p{L}+|\p{N}{1}| ?[^\s\p{L}\p{N}\r\n]+|\s[\r\n]+|\s+(?!\S)|\s+"): error parsing regexp: invalid or unsupported Perl syntax: (?! [recovered] panic: regexp: Compile("(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\r\n\p{L}\p{N}]?\p{L}+|\p{N}{1}| ?[^\s\p{L}\p{N}\r\n]+|\s[\r\n]+|\s+(?!\S)|\s+"): error parsing regexp: invalid or unsupported Perl syntax: (?!

cckate commented 3 months ago

Is anyone watching this？I got the same problem