camel-ai / crab

CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
https://crab.camel-ai.org/
194 stars 28 forks source link

[Question] The CRAB performance is bad on MacOS #35

Open dandansamax opened 2 months ago

dandansamax commented 2 months ago

Required prerequisites

Questions

MacOS is widely used in most of countries. However, our result shows that GPT4o performs bad in the MacOS environment. We should find the reason of it and try to fix the problem.