HumanCompatibleAI / overcooked_ai

A benchmark environment for fully cooperative human-AI performance.
https://arxiv.org/abs/1910.05789
MIT License
714 stars 152 forks source link

Clean up Human-AI / Human-human data collection #115

Closed micahcarroll closed 1 year ago

micahcarroll commented 1 year ago

Uncover what's going on in the Human-AI data collection repo

This repo was used for HH data collection, and has the newer changes from Nathan.

I think once you understand HH data collection repo, it might be easiest to just have a H-AI data collection modality within it (maybe taking inspiration from the repo below on how to structure).

This repo was used for the original H-AI data collection, and is out of date.

The goal is to have only one repo that allows you to do either. One challenge is that psiturk might not work anymore (idk the state of development), but let's cross that bridge when we get there (if it doesn't work). Sandbox psiturk mode and testing things in localhost are your friends.