Open brnikita opened 9 months ago
Estimation: 2 hours
Need to use ticktoken https://cookbook.openai.com/examples/how_to_count_tokens_with_tiktoken
Estimation: 2 hours