Paying Twice When Using Gold Standard

[pammirato]

When I attach a training video to a job, with --train-with, when a worker completes the training video, I see a new completed hit on my account, but the hit is only the training video. The pay is the same amount as the hit for the video I wish to be annotated. So now I am paying workers double. And some workers have only completed the training video but don't do the video I want them to, and so I am essentially paying them for nothing.

Any idea why this is happening?

[gsikheria]

Hi @pammirato I want to crowd source my work in amazon turk. I've near about 3400 frames and in each frame near about 5 cars. I'm confuse how to decide payoff for worker. Please help me how you are deciding payoff.

[pammirato]

There is some guidlines that the workers should get at least $6 per hour (US dollars). If I were you I would make each job smaller than 3400 frames, this way the workers don't get too tirerd or bored in one task and provide higher quality work. Once you have smaller jobs, do one yourself and see how long it takes. Then just apply the $6/hour rule. Don't forget to add in some time for reading instrutions, etc.

[gsikheria]

Thanks @pammirato

[gsikheria]

Hi @pammirato

I'm facing issue while connecting with Amazon Mturk sandbox. My database connection and host connection are fine. I'm new to Mturk, Can you guide me how to get these configuration

signature = "" # AWS secret access key ? accesskey = "" # AWS access key ID ?

Thanks gsikheria