issues
search
eliben
/
go-sentencepiece
Go implementation of the SentencePiece tokenizer
Apache License 2.0
22
stars
2
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
how to support UNIGRAM model
#7
forrestlinfeng
opened
6 days ago
0
optimize encoder
#6
josharian
closed
2 months ago
3
Access to special tokens ids: BOS, EOS, UNK and PAD
#5
janpfeifer
closed
3 months ago
6
separate autogenerated goo from clean api
#4
josharian
closed
3 months ago
1
add api to get vocab size
#3
josharian
closed
3 months ago
6
how do i decode?
#2
josharian
closed
3 months ago
3
load from io.Reader
#1
josharian
closed
3 months ago
0