Open PeterAJansen opened 3 weeks ago
Dear author,
Really appreciate this excellent work! However, some feedbacks hope to be valuable.
Thank you all for this excellent work. :-)
@Dandelionym thanks for sharing additional feedback. Do you have any idea on how best to remove the navigation action and still make sense in a multi-modal environment?
Even for pure text-based games (see ScienceWorld and TextWorld), a minimum of spatial navigation is needed. If we completely abstract it away, then it means all objects can be interacted with at all time, i.e. removing a big chunk of partial observability.
@Dandelionym thanks again -- as an additional follow-up re:API documentation and agents, do you have specific questions about the API documentation ( https://github.com/allenai/discoveryworld , Section 3: "API Documentation"), the agents other than the random agent (e.g. the LLM agent pseudocode scaffold in the API documentation, or the agents in the paper whose code is included in this repository at https://github.com/allenai/discoveryworld/tree/main/agents ) that we can help with?
We've had an external feature request on whether it's possible to remove the navigation/embodiment (e.g. object manipulation) aspects of tasks through setting a flag (e.g.
embodiment = false
) to try to distill the scientific discovery aspects of the tasks from other skills (even more so than the unit tests do).Adding this as a feature request so we can start a thread on how this might be accomplished, since there are a number of implementation routes/challenges:
Some of the challenges here are: