search

NYUCCL / psiTurk

An open platform for science on Amazon Mechanical Turk.
https://psiturk.org
MIT License
277 stars 140 forks source link

An error with worker approve <assignment_id> #424

Closed yunshiuan closed 4 years ago

yunshiuan commented 4 years ago

I ran into an error when I tried to approve an assignment.

worker approve <assignment_id>
Approving specified submissions for the current study...
Response(Operation: approve_assignment_by_assignment_id | Status: error | Exception: An error occurred (RequestError) when calling the ApproveAssignment operation: This operation can be called with a status of: null (1591073846654))

This assignment initially had a status code '1' in the database, but he/she did actually complete the task. So I changed the status code to 4 to label the assignment as submitted. However, when I tried to approve the assignment, it failed with the error message above.

I am using psiTurk version 2.3.9 with python 2.7.

deargle commented 4 years ago

Status 1 indicates big problems with the worker. Your psiturk db doesn't even acknowledge that they completed the task, let alone mturk. It can happen sometimes that psiturk thinks a worker completed a task when actually something failed on the mturk end, and you'd see that error that you saw. But yeah that assignment that you hand edited definitely did not complete it. From psiturk perspective, they didn't even start the task! That would be status 2.

On Mon, Jun 1, 2020, 11:01 PM Chuang, Yun-Shiuan notifications@github.com wrote:

I ran into an error when I tried to approve an assignment.

worker approve Approving specified submissions for the current study... Response(Operation: approve_assignment_by_assignment_id | Status: error | Exception: An error occurred (RequestError) when calling the ApproveAssignment operation: This operation can be called with a status of: null (1591073846654))

This assignment initially had a status code '1' in the database, but he/she did actually complete the task. So I changed the status code to 4 to label the assignment as submitted. However, when I tried to approve the assignment, it failed with the error message above.

I am using psiTurk version 2.3.9 with python 2.7.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/NYUCCL/psiTurk/issues/424, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAI6Y7JEFHSH4INCAKT73BTRUSBT7ANCNFSM4NQMDSJA .

yunshiuan commented 4 years ago

I see. I wonder Is there a way that I can pay the worker regardlessly? The worker's data has been well recorded except there's a bug the prevented him/her to click on the submit bottom.

deargle commented 4 years ago

Look into psiturk whoopsyall project.

On Mon, Jun 1, 2020, 11:13 PM Chuang, Yun-Shiuan notifications@github.com wrote:

I see. I wonder Is there a way that I can pay the worker regardlessly? The worker's data has been well recorded except there's a bug the prevented him/her to the submit bottom.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/NYUCCL/psiTurk/issues/424#issuecomment-637279332, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAI6Y7MD76BYD5XNS2JYAITRUSC5XANCNFSM4NQMDSJA .

yunshiuan commented 4 years ago

Thank you! I noticed that there are quite a few workers with status code 1 or 3, although most of them have status code 4. Some of them have reached out to me and said they had indeed completed the task but weren't able to click on the "complete HIT" button (which calls the psiturk.completeHIT() function). Some of them complained that the error message indicated that the hit has expired (but they didn't exceed the hit duration set by hit create according to the timestamps in the database). I wonder if you could provide some thoughts on what's the reason for this. For example, could it be due to the fact that the server's resource was used up? Thank you in advance!

deargle commented 4 years ago

Closing, see google group for more troubleshooting help pls