dqbd tiktoken issues - Githubissues

dqbd / tiktoken

JS port and JS/WASM bindings for openai/tiktoken

MIT License

647 stars 49 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add support for new text-embedding-3 models

#109 lukasugar opened 10 hours ago
0
Missing ranks files from js-tiktoken

#108 jonasb opened 3 weeks ago
1
Version Packages

#107 github-actions[bot] closed 1 month ago
0
fix(js): specify exports in js-tiktoken

#106 dqbd closed 1 month ago
0
Add `gpt-4o` support

#105 huytool157 closed 3 weeks ago
1
Add support for GPT-4-O, "Omni" model

#104 pkallos closed 1 month ago
6
Add gpt-4o

#103 alvarosevilla95 closed 1 month ago
0
missing example code for js-tiktoken

#102 coding22 opened 1 month ago
0
Replace js-tiktoken BPE merge algorithm with faster heap based algorithm

#101 mikolalysenko opened 2 months ago
2
How to support Llama 3?

#100 wizd opened 2 months ago
0
Performance

#99 steebchen opened 2 months ago
0
Version Packages

#98 github-actions[bot] closed 2 months ago
0
Add GPT-4 Turbo

#97 akynau closed 2 months ago
5
Add `gpt-4-turbo` support

#96 huytool157 closed 2 months ago
0
Add `gpt-4.5-turbo` support

#95 huytool157 closed 1 month ago
0
Add decode_with_offsets function (or PR guidance request)

#94 Sam1320 opened 3 months ago
0
An error occurred during the deployment of the Vercel edge function

#93 bowencool opened 3 months ago
1
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined

#92 TranquilMarmot opened 4 months ago
1
'TextEncoder' is not defined - MongoDB Functions

#91 georgeherby opened 4 months ago
1
Add support for the newest Open AI embeddings models

#90 AleksTrpkovski opened 4 months ago
2
Version Packages

#89 github-actions[bot] closed 5 months ago
0
Fix gpt-3.5-turbo-instrucut model definitions

#88 risu729 closed 5 months ago
3
Version Packages

#87 github-actions[bot] closed 5 months ago
0
Add new models

#86 risu729 closed 5 months ago
7
Add `gpt-4-turbo-preview` to `TiktokenModel`

#85 huytool157 closed 5 months ago
3
Memory access out of bounds

#84 maxdeichmann opened 5 months ago
3
Support Latest Models

#83 johannbuscail closed 5 months ago
1
Crash on React Native: `SyntaxError: Invalid RegExp: Invalid escape`

#82 julian-hecker opened 7 months ago
2
Version Packages

#81 github-actions[bot] closed 7 months ago
0
Plans for gpt-4-turbo variants?

#80 ianschmitz closed 7 months ago
3
Add support for gpt-4-1106-preview

#79 pkallos closed 7 months ago
6
How to count tokens for functions defined in the prompt?

#78 vrde opened 8 months ago
1
Is it reasonable to load and run on the client side ?

#77 MarArMar closed 8 months ago
1
Support fine tunned models

#76 italojs opened 8 months ago
1
Cannot find module error

#75 thdoan opened 8 months ago
1
missing TiktokenModel for version 3.5-turbo-16k

#74 hannahlaek-wt opened 9 months ago
2
gpt-3.5-turbo-instruct support

#73 danny-avila opened 9 months ago
2
What does free actually do?

#72 disbelief opened 9 months ago
9
Add gpt3.5-turbo-instruct model

#71 Prince-Mendiratta closed 5 months ago
1
Raise error when concurrent to call new Tiktoken

#70 qkxie opened 9 months ago
2
Error: null pointer passed to rust

#69 emeeks opened 10 months ago
3
NPM package is very huge

#68 anzemur opened 10 months ago
5
WASM file is not included in Next.js Node runtime API routes

#67 AaronFriel opened 10 months ago
0
Add Electron setup instructions to README

#66 nikwen closed 11 months ago
2
When I look at cl100k_base.json, I don't see the special tokens like <|im_start|>, but when I add them manually I get an error from the wasm

#65 Evertt opened 11 months ago
2
js-tiktoken ES5 support

#64 haolong7 closed 11 months ago
2
NPMJS repository versions are out of date

#63 kjvenalainen opened 11 months ago
2
Fatal crash: BasicBlock requested for unrecognized address

#62 SamStenner opened 11 months ago
1
When running 1.0.7 there is a Missing tiktoken_bg.wasm error on AWS Lambda typescript

#61 haibh-wanosoft opened 11 months ago
3
no such file or directory,_tiktoken_bg.wasm

#60 kiraraty opened 12 months ago
1