FosterFlow / fosterflow

Chat interface for most capable AI models
https://fosterflow.com/
MIT License
16 stars 3 forks source link

Issue with context length #273

Open brnikita opened 9 months ago

brnikita commented 9 months ago

Estimation: 2 hours

Image

brnikita commented 9 months ago

Need to use ticktoken https://cookbook.openai.com/examples/how_to_count_tokens_with_tiktoken