Open lizhuorong opened 7 years ago
Do you mean that the results in Table 1 of your paper is achieved by means of tests deployed on the AMT platform rather than the automatic measures?
The evaluation is essentially user study on Amazon Turk. I will update the evaluation code soon. It just creates javascript for Amazon Turk. There is no automatic measurement.
+1 would like to see the mturk eval code! I'm currently working on a project where your mturk tests would serve as a great starting point.
Hi, I just upload the Amazon Turk scripts on Github. See folder "mturk_scripts".
Thanks : )
Awesome! Thanks!
For the sake of completeness, mind sharing any relevant javascript code you use for the mturk experiments? Thank you!
@tesfaldet I forgot to put the Javascript code on GitHub. I just upload example code in "mturk_scripts".
Thanks a lot for the quick responses :)
Just a heads up that there's no javascript in unlimited_time_comparison/example_javascript.txt Not a problem for me though since I took it from limited_time_comparison/example_javascript.txt.
Would you please release your evaluation implementation? Thank you and I am looking forward to that!