issues
search
knuddelsgmbh
/
jtokkit
JTokkit is a Java tokenizer library designed for use with OpenAI models.
https://jtokkit.knuddels.de/
MIT License
516
stars
38
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
jtokkit produce faster YGC
#50
Taoaozw
closed
9 months ago
1
chore(deps): update dependency gradle to v8.3
#49
renovate[bot]
closed
10 months ago
0
fix(deps): update dependency docusaurus-lunr-search to v2.4.1
#48
renovate[bot]
closed
10 months ago
1
Dose this support use on cloudflare worder edge runtime?
#47
ccbond
closed
11 months ago
0
Add convenience method to count tokens from a list of `com.theokanning.openai.completion.chat.ChatMessage`
#46
sualeh
closed
6 months ago
2
fix(deps): update junit5 monorepo to v5.10.0
#45
renovate[bot]
closed
10 months ago
0
fix(deps): update dependency clsx to v2
#44
renovate[bot]
closed
11 months ago
0
chore(deps): update dependency gradle to v8.2.1
#43
renovate[bot]
closed
12 months ago
0
Commercial use
#42
navin1998
closed
1 year ago
1
chore(deps): update dependency gradle to v8.2
#41
renovate[bot]
closed
1 year ago
0
fix: add gpt model type
#40
CaptainRuby
closed
1 year ago
0
support android
#39
Trree
closed
9 months ago
2
About gpt-3.5-turbo maxContextLength
#38
Bazingabc
closed
1 year ago
1
chore(deps): update dependency typescript to v5.1.6
#37
renovate[bot]
closed
1 year ago
0
chore(deps): update dependency @tsconfig/docusaurus to v2
#36
renovate[bot]
closed
1 year ago
0
chore(deps): update dependency typescript to v5.1.5
#35
renovate[bot]
closed
1 year ago
0
fix issue https://github.com/knuddelsgmbh/jtokkit/issues/33
#34
VoidIsVoid
closed
1 year ago
1
different token values between java and python
#33
VoidIsVoid
closed
1 year ago
1
chore(deps): update dependency typescript to v5.1.3
#32
renovate[bot]
closed
1 year ago
0
chore(deps): update dependency pyperf to v2.6.1
#31
renovate[bot]
closed
1 year ago
0
Count is different
#30
caopengan
closed
1 year ago
6
Way to only include encodings needed
#29
phazei
opened
1 year ago
2
Azure openai-api Content transfer token accuracy problem
#28
gitLinan
closed
1 year ago
2
Is the Korean token calculation method different from GPT tokenizer?
#27
DanielDonghaKim
closed
1 year ago
1
fix(deps): update docusaurus monorepo to v2.4.1
#26
renovate[bot]
closed
1 year ago
0
chore(deps): update dependency tiktoken to v0.4.0
#25
renovate[bot]
closed
1 year ago
0
Add LazyEncodingRegistry
#24
blackdiz
closed
1 year ago
1
Is there a way to only load the encoding needed?
#23
blackdiz
closed
1 year ago
5
fix(deps): update junit5 monorepo to v5.9.3
#22
renovate[bot]
closed
1 year ago
0
Could not load /com/knuddels/jtokkit/r50k_base.tiktoken from resources
#21
hahashuai
closed
1 year ago
1
fix(deps): update dependency prism-react-renderer to v2
#20
renovate[bot]
closed
1 year ago
1
Chinese characters
#19
jiangyklala
closed
1 year ago
2
chore(deps): update dependency gradle to v8.1.1
#18
renovate[bot]
closed
1 year ago
0
fix(deps): update react monorepo to v18 (major)
#17
renovate[bot]
closed
1 year ago
2
ci: make some ci names a little less verbose
#16
tox-p
closed
1 year ago
0
fix(deps): update dependency @mdx-js/react to v2
#15
renovate[bot]
closed
1 year ago
1
chore(deps): update dependency typescript to v5
#14
renovate[bot]
closed
1 year ago
0
chore(deps): update plugin me.champeau.jmh to v0.7.1
#13
renovate[bot]
closed
1 year ago
0
Add 'maxTokens' parameter to the 'encode' and 'encodeOrdinary' methods
#12
radoslavdodek
closed
1 year ago
10
Dependency Dashboard
#11
renovate[bot]
opened
1 year ago
0
chore(deps): update dependency gradle to v8.1
#10
renovate[bot]
closed
1 year ago
0
chore(deps): update dependency tiktoken to v0.3.3
#9
renovate[bot]
closed
1 year ago
0
Configure Renovate
#8
renovate[bot]
closed
1 year ago
0
Add max tokens to ModelType
#7
Blarc
closed
1 year ago
2
CPU usage 300%
#6
PlexPt
closed
1 year ago
4
Discrepancy in promptTokens count while using jtokkit with OpenAI's GPT-3 API
#5
czqclm
closed
1 year ago
2
Counting Tokens
#4
Matthaeus07
closed
1 year ago
4
Is it possible to get sliced string with limited token
#3
jiangying000
closed
1 year ago
2
May I ask if you support the GPT-3.5-tubor model, and if so, how can I use it?
#2
MrWangGang
closed
1 year ago
2
how to split 1000 token chunk from a long text with 9999 token.
#1
entroxu
closed
1 year ago
2
Previous
Next