search

CQFIO / PhotographicImageSynthesis

Photographic Image Synthesis with Cascaded Refinement Networks
https://cqf.io/ImageSynthesis/
1.25k stars 226 forks source link

evaluation implementation #8

Open lizhuorong opened 7 years ago

lizhuorong commented 7 years ago

Would you please release your evaluation implementation? Thank you and I am looking forward to that!

lizhuorong commented 7 years ago

Do you mean that the results in Table 1 of your paper is achieved by means of tests deployed on the AMT platform rather than the automatic measures?

CQFIO commented 7 years ago

The evaluation is essentially user study on Amazon Turk. I will update the evaluation code soon. It just creates javascript for Amazon Turk. There is no automatic measurement.

tesfaldet commented 7 years ago

+1 would like to see the mturk eval code! I'm currently working on a project where your mturk tests would serve as a great starting point.

CQFIO commented 7 years ago

Hi, I just upload the Amazon Turk scripts on Github. See folder "mturk_scripts".

lizhuorong commented 7 years ago

Thanks : )

tesfaldet commented 7 years ago

Awesome! Thanks!

tesfaldet commented 6 years ago

For the sake of completeness, mind sharing any relevant javascript code you use for the mturk experiments? Thank you!

CQFIO commented 6 years ago

@tesfaldet I forgot to put the Javascript code on GitHub. I just upload example code in "mturk_scripts".

tesfaldet commented 6 years ago

Thanks a lot for the quick responses :)

tesfaldet commented 6 years ago

Just a heads up that there's no javascript in unlimited_time_comparison/example_javascript.txt Not a problem for me though since I took it from limited_time_comparison/example_javascript.txt.