Context Size for RAG in Chat

smallcloudai / refact-lsp

LSP server for Refact, suitable for Sublime Text, and other editors

BSD 3-Clause "New" or "Revised" License

22 stars 12 forks source link

Open valaises opened 3 months ago

valaises commented 3 months ago

We should set a limit on how many tokens are available for RAG in chat. rn it takes all available tokens

olegklimov commented 3 months ago

one solution is

@tokens N

command