Server Side Token Counting

[sweep-ai[bot]]

PR Feedback (click)

• [ ] 👍 Sweep Did Well
• [ ] 👎 Sweep Needs Improvement

  Description

  This pull request includes changes to the src/utils/tiktoken.ts file. It modifies the countTokensSingleMessage function to calculate the token count for a single chat message, accounting for metadata tokens. It also updates the countTokens function to handle different scenarios and provide more detailed token counts.

Additionally, the pull request adds a TODO comment to remind developers to add or update tests for the new cases introduced in the code.

Summary

• Modified the countTokensSingleMessage function to calculate the token count for a single chat message, accounting for metadata tokens.
• Updated the countTokens function to handle different scenarios and provide more detailed token counts.
• Added a TODO comment to remind developers to add or update tests for the new cases introduced in the code.

Fixes #17.

---

🎉 Latest improvements to Sweep:

• Sweep uses OpenAI's latest Assistant API to plan code changes and modify code! This is 3x faster and significantly more reliable as it allows Sweep to edit code and validate the changes in tight iterations, the same way as a human would.
• Sweep now uses the rope library to refactor Python! Check out Large Language Models are Bad at Refactoring Code. To have Sweep refactor your code, try sweep: Refactor <your_file>.py!

---

💡 To get Sweep to edit this pull request, you can:

• Comment below, and Sweep can edit the entire PR
• Comment on a file, Sweep will only modify the commented file
• Edit the original issue to get Sweep to recreate the PR from scratch

[sweep-ai[bot]]

Sandbox Executions

[sweep-ai[bot]]

Apply Sweep Rules to your PR?

• [ ] Apply: All new business logic should have corresponding unit tests.
• [ ] Apply: Refactor large functions to be more modular.
• [ ] Apply: Add docstrings to all functions and file headers.

[netlify[bot]]

❌ Deploy Preview for endless-chat failed.

Name	Link
🔨 Latest commit	5cb9594b6e0374098168747c4b9f051bf1cac4b1
🔍 Latest deploy log	https://app.netlify.com/sites/endless-chat/deploys/6568794d58008900088b4f8b

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
44444444444	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 30, 2023 0:02am
emphasize	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 30, 2023 0:02am
endless-chat	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 30, 2023 0:02am
free-chat	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 30, 2023 0:02am
free-chat-personal	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 30, 2023 0:02am

[netlify[bot]]

❌ Deploy Preview for chat-for-free failed.

Name	Link
🔨 Latest commit	5cb9594b6e0374098168747c4b9f051bf1cac4b1
🔍 Latest deploy log	https://app.netlify.com/sites/chat-for-free/deploys/6568794dc0dd4d00084aea1c

[CNSeniorious000]

还需要在 /api/generate.ts 中加上和 components/Generator.tsx 中一样的裁剪 messages 的逻辑

[sweep-ai[bot]]

❌ Failed to make changes

Please join our Discord to report this issue.