issues
search
knuddelsgmbh
/
jtokkit
JTokkit is a Java tokenizer library designed for use with OpenAI models.
https://jtokkit.knuddels.de/
MIT License
516
stars
38
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fix(deps): update junit5 monorepo to v5.10.3
#100
renovate[bot]
opened
5 days ago
0
feat: Implement o200k_base encoding and support gpt-4o
#99
chatanywhere
opened
1 month ago
10
chore(deps): update dependency pyperf to v2.7.0
#98
renovate[bot]
opened
1 month ago
0
Return position to EncodingResult (#80)
#97
imsosleepy
opened
1 month ago
0
Implement o200k_base encoding
#96
nayavu
opened
1 month ago
2
chore(deps): update dependency tiktoken to v0.7.0
#95
renovate[bot]
opened
1 month ago
0
add gpt-4-turbo model
#94
dafriz
opened
2 months ago
0
chore(deps): update peaceiris/actions-gh-pages action to v4
#93
renovate[bot]
opened
2 months ago
0
increase gpt-3.5-turbo maxContextLength to 16k
#92
dafriz
opened
2 months ago
0
Add Encoding.calcCharCountForTokens method
#91
dimafa
opened
3 months ago
0
chore(deps): update dependency gradle to v8.8
#90
renovate[bot]
opened
3 months ago
0
Can't work on GraalVM complied Java APP
#89
kusuri-h
closed
3 months ago
2
chore(deps): update dependency pyperf to v2.6.3
#88
renovate[bot]
closed
3 months ago
0
Sync with tiktoken
#87
paplorinc
opened
4 months ago
0
chore(deps): update dependency tiktoken to v0.6.0
#86
renovate[bot]
closed
4 months ago
0
added two new embedding model's encoding
#85
paplorinc
closed
4 months ago
1
fix(deps): update junit5 monorepo to v5.10.2
#84
renovate[bot]
closed
4 months ago
0
chore(deps): update dependency gradle to v8.6
#83
renovate[bot]
closed
5 months ago
0
chore(deps): update gradle/gradle-build-action action to v3
#82
renovate[bot]
closed
5 months ago
0
Added Encoding.calcCharCountForTokens method
#81
dimafa
closed
3 months ago
1
Return position to EncodingResult
#80
dimafa
opened
5 months ago
4
fix(deps): update dependency clsx to v2.1.0
#79
renovate[bot]
closed
6 months ago
0
Azure OpenAI All ChatMessages nums 21 less
#78
XinHua-Zhu
opened
6 months ago
3
3) Add a dedicated fragment splitter for the cl100k encoding - 3.8s to 2.1s
#77
paplorinc
closed
4 months ago
0
2) Optimize byte pair merge for small and big character sequences - 8.2s to 3.9s
#76
paplorinc
closed
6 months ago
0
1) Optimize 50k & 100k splitter regular expressions - 10.5s to 8.9s
#75
paplorinc
closed
6 months ago
0
feat(gpt-4) add gpt 4 turbo
#74
riadhriadh
opened
6 months ago
1
chore(deps): update dependency tiktoken to v0.5.2
#73
renovate[bot]
closed
6 months ago
0
chore(deps): update actions/setup-java action to v4
#72
renovate[bot]
closed
6 months ago
0
chore(deps): update dependency gradle to v8.5
#71
renovate[bot]
closed
6 months ago
0
chore(deps): update dependency typescript to v5.3.3
#70
renovate[bot]
closed
6 months ago
1
com.knuddels.jtokkit.api.ModelType：Not including chatgpt4 turbo
#69
gonglb
opened
7 months ago
4
fix(deps): update junit5 monorepo to v5.10.1
#68
renovate[bot]
closed
6 months ago
0
chore(deps): update dependency pyperf to v2.6.2
#67
renovate[bot]
closed
6 months ago
0
fix(deps): update docusaurus monorepo to v3 (major)
#66
renovate[bot]
closed
6 months ago
2
chore(deps): update plugin me.champeau.jmh to v0.7.2
#65
renovate[bot]
closed
6 months ago
0
fix(deps): update dependency @mdx-js/react to v3
#64
renovate[bot]
closed
8 months ago
1
can you include the mvn bnd plugin to generate a osgi/bundle correct manifest?
#63
jcompagner
opened
8 months ago
2
chore(deps): update actions/setup-node action to v4
#62
renovate[bot]
closed
8 months ago
0
chore(deps): update dependency gradle to v8.4
#61
renovate[bot]
closed
8 months ago
0
Produces GC and Hangs for a second or two.
#60
Shvet
closed
6 months ago
2
fix(deps): update docusaurus monorepo to v2.4.3
#59
renovate[bot]
closed
8 months ago
0
Support Vertex AI's PaLM models
#58
glaforge
closed
6 months ago
1
fix(deps): update dependency docusaurus-lunr-search to v3
#57
renovate[bot]
closed
8 months ago
1
chore(deps): update dependency @tsconfig/docusaurus to v2.0.2
#56
renovate[bot]
closed
8 months ago
0
chore(deps): update dependency tiktoken to v0.5.1
#55
renovate[bot]
closed
9 months ago
0
chore(deps): update actions/checkout action to v4
#54
renovate[bot]
closed
8 months ago
0
fix(deps): update dependency docusaurus-lunr-search to v2.4.2
#53
renovate[bot]
closed
8 months ago
1
support claude
#52
an9xyz
closed
6 months ago
1
chore(deps): update dependency typescript to v5.2.2
#51
renovate[bot]
closed
10 months ago
0
Next