sujiez
commented
6 years ago I found after worker have done works, you need to review it and reject poor works. turkic invalidate --hit hitid is not enough for rejecting works. Instead, you need to call turkic compensate --reject FILE first (and then other works), where FILE is a path to file which has a list of assignment id to reject.
First of all, I think Vatic is an awesome tool to collect video labels, it greatly save the time for data collection. While using Vatic, I have a small question. When I publish HITs, money will be subtracted from my account as funds for liability (https://requester.mturk.com/help/faq#funds_held_for_liability). Seems like when I disable tasks or reject results from turks due to low quality, those funds will come back to my balance. However, after I use "turkic invalidate workerid --no-publish" which disable HITs and block the specific turker, I did not see any immediate refund to my balance. Therefore, I am writing to ask if the liability fund will be refund to my balance? Thank you very much.