microsoft / vscode-commander

MIT License
8 stars 3 forks source link

Set editor layout ask is slow #78

Closed sandy081 closed 1 month ago

sandy081 commented 1 month ago

Asking Set grid layout to 2 rows and 3 columns is getting executed very slowly. I think this is because we are sending multiple model requests to validate the args. IMO this should be handled by prompt engineering - Improve the prompt so that the model invokes the command with proper arguments. I also think the command should not be asked to run multiple times

Image

benibenj commented 1 month ago

Yes, was planning on cleaning that up next month. This can be solved with running a single model request in the background using hidden tools. The prompt engineering part is possible, but our experience has shown that this is much less reliable and the LLM might spit out a very large text talking about the arguments it is passing which is not really what we want to make visible to the user.