[Feature Request] Change `GroundingDino` action to transformers version

camel-ai / crab

CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/

https://crab.camel-ai.org/

186 stars 26 forks source link

Closed dandansamax closed 1 month ago

dandansamax commented 2 months ago

[X] I have searched the Issue Tracker that this hasn't already been reported. (+1 or comment there if it has.)

Current GroundingDino implementation is thirdparty. It's hard to modify and maintain.

Delete the thirdparty code from CRAB
Introduce transformers GroundingDino Model and move the visual prompt actions inside CRAB package.

No response