edbeeching / godot_rl_agents_examples

Example Environments for the Godot RL Agents library
MIT License
37 stars 13 forks source link

Adds SimpleReachGoal test env #33

Closed Ivan-267 closed 3 months ago

Ivan-267 commented 4 months ago

This is a quickly made lightweight fast-training env without external assets or other dependencies for testing. It was made to have a very simple env to test how easy it is to switch it to C#, but it can optionally also be used for quick GDRL tests after some changes, adding new wrappers, etc.

Due to above, it's added in a separate folder for such envs that might not have the full functionality/design of standard examples.

I was able to train it successfully in just 50 000 steps (~3 min) with a single env from Godot editor, after lowering initial log_std to log(0.5). There might be run-to-run variance but it should be trainable quickly in any case.

Plugin included is the latest main version (not the experimental branches).

https://github.com/edbeeching/godot_rl_agents_examples/assets/61947090/88a49aa6-2bc7-48c8-b625-fbb1fc65a6ad

More info is in the readme: https://github.com/edbeeching/godot_rl_agents_examples/tree/AddSimpleTestEnv/examples/TestExamples/SimpleReachGoal

Update: Added a C# variant that has the extended AIController written in gdscript, and the rest of the game files in C#.

Ivan-267 commented 3 months ago

@edbeeching This should be ready for merging now, I'm just making the final updates to the guide (https://github.com/edbeeching/godot_rl_agents/pull/184).

We now have the example implemented in Gdscript, CSharp and CSharpAll (explained in the guide: https://github.com/edbeeching/godot_rl_agents/blob/add_working_with_c_sharp_doc/docs/WORKING_WITH_CSHARP.md)

The idea is to merge this first, then update the links to this example in the guide (so they point to main branch) and merge it as well.