issues
search
Hugging-Face-Supporter
/
tftokenizers
Use Huggingface Transformer and Tokenizers as Tensorflow Reusable SavedModels
Apache License 2.0
9
stars
4
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Repository doesn't contain covert.py file
#22
Captaindoggo
opened
1 year ago
0
Can't reproduce the exampe in the Readme
#21
IlnarSelimcan
opened
1 year ago
3
Missing trace on some of the tokenizer functions
#20
MarkusSagen
opened
2 years ago
0
Remove dependencies
#19
MarkusSagen
opened
2 years ago
0
[Optional] Provide TFAutoModels for different head types
#18
MarkusSagen
opened
2 years ago
0
Reduce tensorflow noise
#17
MarkusSagen
opened
2 years ago
0
Use built in function to access special tokens and ids
#16
MarkusSagen
opened
2 years ago
0
Remove unneeded dependencies
#15
MarkusSagen
closed
2 years ago
0
Include-more-bert-tokenizers
#14
MarkusSagen
closed
2 years ago
0
Add support for KB-BERT
#13
MarkusSagen
closed
2 years ago
1
Remove deprecated class `TFTokenizerBase`
#12
MarkusSagen
opened
2 years ago
0
Describe how more tokenizers can be added
#11
MarkusSagen
opened
2 years ago
0
BertTokenizer may not be optimal choice for converstion
#10
MarkusSagen
opened
2 years ago
0
Support sentence-transformers
#9
MarkusSagen
closed
2 years ago
0
Provide examples for NER, QA, Classification examples
#8
MarkusSagen
opened
2 years ago
0
Support GPT-sw3
#7
MarkusSagen
opened
2 years ago
0
Support T5
#6
MarkusSagen
opened
2 years ago
0
Conversion to BERT models always makes lowercase
#5
MarkusSagen
closed
2 years ago
1
Tokenizers do not convert tokens correctly
#4
MarkusSagen
closed
2 years ago
2
Tokenizer's `model_max_length` is not consistent
#3
MarkusSagen
opened
2 years ago
0
Enable more tokenizers, s.a. SentencePiece
#2
MarkusSagen
opened
2 years ago
0
Load tokenizer with `from_pretrained`
#1
MarkusSagen
closed
2 years ago
0