search

allenai / amti

A Mechanical Turk Interface (amti) 🤖
Apache License 2.0
55 stars 18 forks source link

Environment-based hittypeproperties.json #26

Open nalourie-ai2 opened 4 years ago

nalourie-ai2 commented 4 years ago

A common use-case is having different HIT type properties for the live site versus the sandbox, since test accounts on the sandbox often don't have high enough qualifications to work the HITs.

This feature would enable users to define, in their definition directories, separate HIT type properties for the different amti environments.

nalourie-ai2 commented 4 years ago

An alternative feature that'd serve the same purpose would be to add a --quals/--no-quals flag. Thus, when posting to the sandbox, users could omit the quals if desired.