Closed MarcCote closed 1 year ago
@aphedges hopefully this PR is not breaking anything on your side. You can still use the former task name convention. Let me know if that's not the case.
@aphedges hopefully this PR is not breaking anything on your side. You can still use the former task name convention. Let me know if that's not the case.
It might break some stuff, but we have enough internal breakage that we already have scripts to do task name translation.
ISI is currently on break, so it won't be something we will be discussing until January.
Once I'm done with https://github.com/allenai/ScienceWorld/pull/37, there will be some breaking changes too. I plan to make ScienceWorld compatible with Gymnasium to handle vectorization.
Currently, there is a mismatch between task IDs mentioned in the paper and the ones used in the code.
For instance, in the code "Measurement" task has ID 10-*,
and in the paper it is ID 2![image](https://user-images.githubusercontent.com/660004/208559619-e2bfd82b-b2fe-42a0-b125-03ea61aae686.png)
This PR addresses this issue by removing the prefix "task-ID-" from the task names. Also, this PR changes the
env.load(...)
function to accept a proper task ID to load a task, e.g.env.load("2-3")
.Last, a Python script is available to list all task names, their IDs, and number of variations.
python scripts/list_scienceworld_task.py