Tiktoken usage for estimating number of tokens in prompt / response, fitting semantic search results to target token num #26

Closed Nayjest closed 3 months ago