JHU-CLSP / turking-bench

Web-grounded natural language instructions
https://turkingbench.github.io
Apache License 2.0
11 stars 6 forks source link

Fixed Opinion Mining of Spanish Customer Comments HIT2 tasks, run_single QOL, Fixed Style Adaptaion - Subjective-Objective, Fixed intuitive physics 01 #86

Closed klxu03 closed 11 months ago

klxu03 commented 11 months ago

Fixed Opinion Mining of Spanish Customer Comments HIT2, Style Adaptaion - Subjective-Objective, intuitive physics 01

Quality of Life updates to run_single with RUN_ALL allowing you to toggle between testing all instances of a task to a single index easily just by modifying the global variables.

i also made RUN_ALL control the headless property, since if u r going to speed run through all the instances i think headless should be turned on. I also turned on HiddenPrints for this so the print statements will be hidden during this run so it runs faster locally. If it just finishes quietly, it succeeds, otherwise it will error out if a score is less than 1 or if an actual error occurred during running

klxu03 commented 11 months ago

@danyaljj