web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
647 stars 94 forks source link

Update the Postmill Image #82

Open shuyanzhou opened 7 months ago

shuyanzhou commented 7 months ago

The voting function is broken right now, if an upvote/downvote is applied, the voting will be reset to -1.

@robert1003 recently fixed it. @frankxu2004 please coordinate and see what is the best way to apply the patch

Note: It does not influence our current evaluations, but it will be good to have the correct functionalities in general.

robert1003 commented 6 months ago

@frankxu2004 @shuyanzhou the new image is here: https://drive.google.com/drive/folders/1lboUgbt_rUrS9DtHH8XX0onECJju8BBh?usp=sharing

Four fix:

  1. voting function is fixed for both comments and posts
  2. new comments and posts will be sorted correctly (posts that are just created will be put in front when sorted by "new")
  3. Make 'MarvelsGrantMan136' user a trusted user: UPDATE users SET trusted = true WHERE username = 'MarvelsGrantMan136';. Non-trusted user can only make 3 posts per hour while trusted user can make 15 posts per five minutes.
  4. After voting function is fixed some pages with large number of votes become very slow. Speed up forum entry page by commenting out src/Repository/SubmissionRepository.php:L55-66. This makes voting slightly slower but make page loading a lot faster.