web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
632 stars 90 forks source link

Support to have Webarena as a TorchRL environment #105

Open agrawalraj opened 4 months ago

agrawalraj commented 4 months ago

Thank you for creating this cool dataset! I would like to use the RL algorithms in TorchRL but that requires that Webarena be written in terms of TensorDict. TorchRL supports many simulation backends such as gym based on this note https://pytorch.org/rl/reference/generated/torchrl.envs.GymEnv.html#torchrl.envs.GymEnv.

It seems like Webarena is based on gym too so it seems plausible to use TorchRL with Webarena. Any thoughts / suggestions here?

I would be happy to submit a PR to add TorchRL support if it's not currently possible.