search

NYUCCL / psiTurk

An open platform for science on Amazon Mechanical Turk.
https://psiturk.org
MIT License
277 stars 140 forks source link

Add lab mode #95

Closed jbmartin closed 5 years ago

jbmartin commented 10 years ago

Several people have expressed interest in a lab mode. This can be done with the current version, but it's a little unpolished and non-obvious.

jbmartin commented 10 years ago

This feature should be included with the modeification changes in 2.1.0.

gureckis commented 10 years ago

any idea on how it should work? it's possible this needs to be integrated in with any attempt at a more sophisticated random assignment/balancing scheme because you might want to randomly assign lab subjects using the same mechanism (or override it in particular situations).

jbmartin commented 10 years ago

The challenging part of this was taken care of in 2.1.0. All that's left is polishing the CLI.

JSlote commented 10 years ago

I would be glad to look into polishing the CLI. What specifically were you imagining?

twiecki commented 6 years ago

Any progress on this? Is it possible at all?

deargle commented 6 years ago

Sure, just generate and distrubute your own entry urls and use "mode=lab" in the url instead. Skip /ad, go straight to /consent or wherever.

On Mon, Jan 8, 2018, 12:49 PM Thomas Wiecki notifications@github.com wrote:

Any progress on this? Is it possible at all?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/NYUCCL/psiTurk/issues/95#issuecomment-356076009, or mute the thread https://github.com/notifications/unsubscribe-auth/ABHsfcJtgJY8X78IakJQcTtE5y6ySU9wks5tInFJgaJpZM4B58Qw .

twiecki commented 6 years ago

Is there a difference to using mode=debug which allows me to just use whatever IDs I want if I understand correctly?

deargle commented 6 years ago

You can use whatever ids you want for anything that's not "live" or "sandbox". Model=debug in conjunction with prefixing other url parameters with the string "debug" disables the "if you quit now, you'll be marked as a quitter" functionality. Besides that, there would be no difference between "mode=debug" and "lab". Look through experiment.py to see how it all works, including the /complete route in there.

On Mon, Jan 8, 2018, 1:10 PM Thomas Wiecki notifications@github.com wrote:

Is there a difference to using model=debug which allows me to just use whatever IDs I want if I understand correctly?

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/NYUCCL/psiTurk/issues/95#issuecomment-356081580, or mute the thread https://github.com/notifications/unsubscribe-auth/ABHsfUgZdfMckbEfgtFu6a3IDVAi_Ihzks5tInYYgaJpZM4B58Qw .

twiecki commented 6 years ago

I couldn't find a note of "lab" in experiment.py?

deargle commented 6 years ago

Look at how "mode" is used in there. E.g., in /complete, if not "live" or "sandbox" , then...

On Tue, Jan 9, 2018, 8:58 AM Thomas Wiecki notifications@github.com wrote:

I couldn't find a note of "lab" in experiment.py?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/NYUCCL/psiTurk/issues/95#issuecomment-356326563, or mute the thread https://github.com/notifications/unsubscribe-auth/ABHsfbmszWSj6EWhMi5nGQGKNZVvkGhFks5tI4yZgaJpZM4B58Qw .

twiecki commented 6 years ago

I see, so it doesn't have to be lab but just not live, sandbox, or debug.

deargle commented 6 years ago

Right.

On Wed, Jan 10, 2018, 4:23 AM Thomas Wiecki notifications@github.com wrote:

I see, so it doesn't have to be lab but just not live, sandbox, or debug.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/NYUCCL/psiTurk/issues/95#issuecomment-356574764, or mute the thread https://github.com/notifications/unsubscribe-auth/ABHsfYQ4-1qXBjW8gxTc98OtqrZ_cDjdks5tJJ3CgaJpZM4B58Qw .