After releasing the initial version of the WebArena test set, we and the community discovered errors and imperfections in the evaluation annotations. The WebArena team is actively performing another pass on the evaluation annotation, and taking community issues. We plan to fix all known issues as soon as possible.
After releasing the initial version of the WebArena test set, we and the community discovered errors and imperfections in the evaluation annotations. The WebArena team is actively performing another pass on the evaluation annotation, and taking community issues. We plan to fix all known issues as soon as possible.