Use Anthropic's new computer automation right on your own Mac. Feel free to make PR's theres definitely improvements we can all make to fully get the best capabilities.
MIT License
56
stars
8
forks
source link
Include Mouse Pointer in Screenshot, Limit Screenshot Size #2
The Mac version has some limitations in taking screenshots because it removes the pointer, making it difficult for Sonnet to know where to click. Additionally, I often encounter errors due to image file sizes, which may be related to the resolution at which screenshots are taken. Lowering the desktop resolution does not solve this issue.
newideas99
commented
3 weeks ago
This is great! Thanks for setting this up.
The Mac version has some limitations in taking screenshots because it removes the pointer, making it difficult for Sonnet to know where to click. Additionally, I often encounter errors due to image file sizes, which may be related to the resolution at which screenshots are taken. Lowering the desktop resolution does not solve this issue.
BadRequestError: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'messages.6.content.0.tool_result.content.0.image.source.base64: image exceeds 5 MB maximum: 5807300 bytes > 5242880 bytes'}}