JHU-CLSP / turking-bench

Web-grounded natural language instructions
https://turkingbench.github.io
Apache License 2.0
13 stars 6 forks source link

Fixed Arch, Dialogue Safety 5, wiki103, Ethnologue, Step 2, Word Formality, and more #90

Closed klxu03 closed 1 year ago

klxu03 commented 1 year ago

Added in tasks_should_skip array including Photo Collection task.

Skipping Photo Collection task since it requires model to look on the web for more info, and requires model to access info by clicking out onto the news site

ATOMIC - Required Objects (Sequence) 9 I "fixed" it in my branch in the sense the score is 1.00 now, however, there are no actual inputs happening atm. passed jacob to make the oracle model actaully put in inputs

@danyaljj