Handle correctly higher token limits

smallcloudai / refact-vscode

Refact AI: Open-source AI Code assistant with autocompletion, chat, refactoring and more for VS Code

https://refact.ai

BSD 3-Clause "New" or "Revised" License

68 stars 24 forks source link

Handle correctly higher token limits #105

Closed Timon-IW closed 5 months ago

Timon-IW commented 6 months ago

Hello,

I don't know where to ask elsewhere, what is the Limit of lines that the chat can support? I regularly run into the problem that the only answer I get is "Sure, how can I assist you today?" and nothing else. If I ask him again, It tells me to provide the code, and then it's just a loop.

olegklimov commented 6 months ago

Interesting!

Can you give a screenshot or the question?

Timon-IW commented 5 months ago

RefactAI

Here I gave it my Code, which is approximately 500 lines long, and sent the prompt "can you comment my code?" As you see, it won't do it. Instead, gave me the answer: "Sure, how can I assist you today?"

olegklimov commented 5 months ago

Aha, I see. Then it's two things to fix:

Fix the preview so it says the input message doesn't fit into the context
Maybe find a way to increase the context allowed so text like this fits

Thanks for reporting again, those two are good ideas to progress.

valaises commented 5 months ago

@Timon-IW The issue appears to be fixed in Refact v3.1.114