Open valaises opened 3 months ago
We should set a limit on how many tokens are available for RAG in chat. rn it takes all available tokens
one solution is
@tokens N
command
We should set a limit on how many tokens are available for RAG in chat. rn it takes all available tokens