search

SkyworkAI / agent-studio

Benchmarks, environments, and toolkits for general computer agents
https://skyworkai.github.io/agent-studio/
GNU Affero General Public License v3.0
153 stars 11 forks source link

Create more tasks in gmail evaluator #10

Closed AIDefender closed 7 months ago

AIDefender commented 8 months ago

Currently playground/desktop_env/eval/google_evaluators/gmail_evaluator.py only has draft-related tasks like create_draft, get_recent_draft, and deduplicate_draft. More tasks can be added, such as sending drafts, organizing emails from specific senders, handling attachments, managing email signatures, and so on.

@AIDefender will handle it. Is that OK?

ltzheng commented 8 months ago

Thanks! You can refer to the guidelines in CONTRIBUTING.md.

AIDefender commented 8 months ago

Thanks! You can refer to the guidelines in CONTRIBUTING.md.

OK Sure.

AIDefender commented 7 months ago

I noticed that in gmail.py line 201, the send_message function was commented by @thisiszy . What was the concern then and should we uncomment it to continue the development?

thisiszy commented 7 months ago

I noticed that in gmail.py line 201, the send_message function was commented by @thisiszy . What was the concern then and should we uncomment it to continue the development?

Yes, you can uncomment this. I commented out this because I use my private Google account for development and don't want to send unwanted emails accidentally.

AIDefender commented 7 months ago

Added in PR #13