Consider fallback to `js-tiktoken` if failing to import `tiktoken` - Githubissues

CNSeniorious000 / free-chat

forked from @anse-app/chatgpt-demo. Index site at https://free-chat.asia

https://endless-chat.vercel.app

MIT License

174 stars 52 forks source link

Consider fallback to `js-tiktoken` if failing to import `tiktoken` #15

Open CNSeniorious000 opened 8 months ago

CNSeniorious000 commented 8 months ago

To-dos:

[ ] Use js-tiktoken at frontend
[ ] Slice messages sliding window at backend: using js-tiktoken
[x] Cache token counting utilities
[ ] Standalone tiktoken page