issues
search
JuliaText
/
WordTokenizers.jl
High performance tokenizers for natural language processing and other related tasks
Other
96
stars
25
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add TokTok tokenizer
#15
oxinabox
closed
5 years ago
7
add reverse tokenizer
#14
aquatiko
closed
5 years ago
13
Add Tweet Tokenizer
#13
Ayushk4
closed
5 years ago
44
Simple reversible tokenizer
#12
MikeInnes
closed
5 years ago
1
`tokenize` API
#11
MikeInnes
opened
6 years ago
9
Make sed-based tokenisers 30x faster
#10
MikeInnes
closed
5 years ago
12
Fix for 1.0
#9
AShedko
closed
6 years ago
4
Fixes Julia 0.7 deprecation warnings
#8
Paethon
closed
6 years ago
6
Write paper for JOSS
#7
oxinabox
closed
4 years ago
7
Standardize spelling of "Tokenizer" with Z throughout the repo
#6
waldyrious
closed
6 years ago
2
[WIP] Port TokTok
#5
oxinabox
closed
5 years ago
0
0.7 compat
#4
oxinabox
closed
6 years ago
1
Add a Twitter tokenizer
#3
oxinabox
closed
5 years ago
8
Minor docs change
#2
oxinabox
closed
6 years ago
1
Reexport RevTok.jl
#1
oxinabox
closed
6 years ago
2
Previous