Issue with ray 1.12.0 and Windows in environment instantiation

[PhilippWillms]

Hello, while trying to execute the related RL project in my development environment:

• Windows 10
• Python 3.9.7
• ray 1.12.0
• numpy 1.22.3
• tensorflow 2.8.0
• gym 0.21.0

I encountered two very basic issues.

1. By default, ray Rllib tries to create a logging directory with the "env" name in it. However, with the configuration "JSSEnv:jss-v1" this leads into error.
2. Ray was not able to identify the JSSEnv by class name, as suggested by ray env documentation

This triggered me to add proper Gym registration (see my fork of JSSEnv and corresponding adjustments on the Rllib execution files (see my fork of RL-Job-Shop-Scheduling).

Kindly review both branches and feel free to merge and adopt.

BR Philipp

[pradeepchandra551]

@PhilippWillms can you please explain the flow to execute the code?