issues
search
openvinotoolkit
/
openvino_tokenizers
OpenVINO Tokenizers extension
Apache License 2.0
18
stars
16
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Propagate _GLIBCXX_USE_CXX11_ABI
#151
Wovchena
closed
3 months ago
1
Ability to use sentensepiece from conda-forge
#150
ilya-lavrenov
closed
3 months ago
0
trigger
#149
Wovchena
closed
3 months ago
0
Package into correct dirs
#148
Wovchena
closed
3 months ago
5
Revert "revert added tokens support"
#147
apaniukov
closed
3 months ago
0
Revert "Added Tokens Support for BPE Tokenizers"
#146
rkazants
closed
3 months ago
0
Support Punctuation Split
#145
apaniukov
closed
3 months ago
0
Added Tokens Support for BPE Tokenizers
#144
apaniukov
closed
3 months ago
0
Update Version To 2024.1.0.2
#143
apaniukov
closed
3 months ago
0
Fixed tokenizers on Windows
#142
ilya-lavrenov
closed
3 months ago
0
Fixed tokenizers on Windows
#141
ilya-lavrenov
closed
3 months ago
1
Ported conda-forge Windows linkage fixes
#140
ilya-lavrenov
closed
3 months ago
0
Version 2024.1.0.1
#139
mryzhov
closed
3 months ago
0
[MERGE][2023.3][WHEEL] Freeze scikit-build-core version #123
#138
mryzhov
closed
3 months ago
0
[MERGE] [WHEEL] Freeze scikit-build-core version #123
#137
mryzhov
closed
3 months ago
0
Simplified code
#136
ilya-lavrenov
closed
3 months ago
0
Fix Windows linking
#135
Wovchena
closed
3 months ago
0
[MERGE] [CONDA] Link sentencepiece with external protobuf #132
#134
mryzhov
closed
3 months ago
0
Llama3 Tokenizer Support
#133
apaniukov
closed
3 months ago
0
[CONDA] Link sentencepiece with external protobuf
#132
mryzhov
closed
3 months ago
0
[WordPiece tokenizer] StringTensorUnpack not supported on gpu
#131
Amadeus-AI
closed
3 months ago
6
[CONDA] use protobuf package
#130
mryzhov
closed
3 months ago
0
[CONDA] Turn off tf frontend
#129
mryzhov
closed
3 months ago
0
[HF] Reorder tensorflow and sentencepiece linking
#128
mryzhov
closed
3 months ago
0
Revert "[CI] Fix macOS tests"
#127
mryzhov
closed
4 months ago
0
looks like re2.dll is missed from binary ditribution
#126
svidiasoftware
closed
3 months ago
1
Add Sequence Post-Processor Support
#125
apaniukov
closed
4 months ago
2
[CI] Use OV released 2024.1 packages
#124
mryzhov
closed
4 months ago
0
[WHEEL] Freeze scikit-build-core version
#123
mryzhov
closed
4 months ago
2
Update tensorflow_translators.cpp
#122
MonalSD
closed
4 weeks ago
3
[TF FE] Support StringSplitV2 with positive maxplit attribute
#121
rkazants
closed
4 months ago
0
[TF FE] Extend support for LookupTableFindV2 with string keys
#120
rkazants
closed
4 months ago
0
Add Tokenizer Benchmarks
#119
apaniukov
closed
4 months ago
0
Cherry Pick For 24.1 Release
#118
apaniukov
closed
4 months ago
0
[TF FE] Optimize EqualStr operation
#117
rkazants
closed
4 months ago
0
Add Missing .model File Error
#116
apaniukov
closed
4 months ago
0
[TF FE] Support StringToHashBucketFast operation
#115
rkazants
closed
4 months ago
0
Port qwen eos token to 2024.0
#114
ilya-lavrenov
closed
4 months ago
0
Fixed compatibility with OpenVINO 2024.0
#113
ilya-lavrenov
closed
4 months ago
0
Cherry-Pick From Master
#112
apaniukov
closed
4 months ago
0
[CI] tokenizers ccache
#111
mryzhov
opened
4 months ago
1
Install torch CPU
#110
ilya-lavrenov
closed
4 months ago
0
Parse QWEN EOD_TOKEN_ID
#109
apaniukov
closed
4 months ago
1
[CI] Temporary removed dependency version of OpenVINO
#108
mryzhov
closed
5 months ago
0
[CI]Switch to OV release branch (2024.1)
#107
mryzhov
closed
5 months ago
0
Add Cache to VocabEncoder
#106
apaniukov
closed
5 months ago
0
[CI]Changed openvino version 2024.2
#105
mryzhov
closed
4 months ago
0
Add RWKV Example to Readme
#104
apaniukov
closed
5 months ago
0
[TF FE] Extend RaggedTensorToSparse conversion extension
#103
rkazants
closed
5 months ago
0
Add forceRunPrecommitScope param to Jenkinsfile
#102
akladiev
closed
5 months ago
0
Previous
Next