anthropics / anthropic-quickstarts

A collection of projects designed to help developers quickly get started with building deployable applications using the Anthropic API
MIT License
6.27k stars 805 forks source link

Is it possible to make computer_use_demo's bash session visible and interactive on the screen? #112

Open aereobert opened 3 days ago

aereobert commented 3 days ago

As title, this would be extremely useful for saving screenshot tokens and increase speed

Also this would enable Claude to use tools like nmtui nano top etc.

chrisgorgo commented 2 days ago

You can disable BashTool and prompt the model to open visual terminal and use it for issuing commands. It wouldn't save tokens though.

aereobert commented 2 days ago

You can disable BashTool and prompt the model to open visual terminal and use it for issuing commands. It wouldn't save tokens though.

Yes that's true, but as far as I can tell, it seemed that interacting with the terminal window is really slow comparing to direct interaction with shell tools. I used edited the bash tool to create a web interface, and it is really useful (yet not perfect and ugly)