search

1715labs / 1715labs-pfe

Modified version of PFE for use with paid crowds
1715labs-pfe.vercel.app
Apache License 2.0
0 stars 0 forks source link

Can sometimes complete a classification on MTurk without accepting a HIT #14

Closed tingard closed 3 years ago

tingard commented 3 years ago

Expected behaviour

Unless a HIT has been accepted, a worker should not be able to interact with the site and submit classifications

Current behaviour

Intermittently, it is possible to interact with the site and navigate through a workflow while in the "preview" mode on MTurk. I haven't tried submitting a classification but I presume this will error.

This may be the cause of some of the strange over-classification we see when using subject-specific URLs...

Steps to replicate

Complete a HIT, without "auto-accept" enabled

Attempt to classify on the preview page before accepting a new HIT.

Additional information

Running windows 10, Chrome 87.0.4280.88

tingard commented 3 years ago

I haven't been able to replicate this, closing for now.