Add more tests to cover all existing environments in MinoWoB++.
Motivation
The current tests only cover a subset of elements. In particular, the tests do not cover the more complex tasks and FlightWoB tasks.
Pitch
Add the following tests on all existing environments in MinoWoB++.
Start a web server automatically for FlightWoB tasks (the file:// protocol does not work).
Confirm that reset() and step() work on the task without errors, and that getting a reward is possible.
Confirm seed determinism.
For tasks with algorithmic solutions, confirm that the tasks can be solved (with positive rewards).
Confirm that all observations and actions are in the spaces (e.g., test if the numerical values are within the bounds; test the length and charset of Text spaces).
Alternatives
Manual verification (e.g., interacting with the tasks on Google Chrome).
Additional context
None.
Checklist
[x] I have checked that there is no similar issue in the repo (required)
Proposal
Add more tests to cover all existing environments in MinoWoB++.
Motivation
The current tests only cover a subset of elements. In particular, the tests do not cover the more complex tasks and FlightWoB tasks.
Pitch
Add the following tests on all existing environments in MinoWoB++.
file://protocol does not work).reset()andstep()work on the task without errors, and that getting a reward is possible.Alternatives
Additional context
None.
Checklist