How can I use this package？

[zzt007]

Hi，Thanks for your great job! I have finisher all the work that are mentioned in readme . How to use the RL algorithms you mentioned in the paper ? Looking forward to your reply.

[hmer101]

Hi there, interfacing with the RL algorithms is done through OpenAI Gym. The definitions of the interfacing functions (see 'step' here in particular) is done in the fsd_env.py file. Examples of how to call the functions for training and inference can be found in the main_test.py file.

If you need more help, the original repository for the RL algorithm implementations provides examples on how to interface with the RL algorithms!

[zzt007]

Thanks for your reply. I just start to learn DRL, and I want to prepare for the deployment of the model to the FSAE full-size car by learning this interesting project. I also read another paper about FSAE and RL from your university, which is also a very interesting work.

But I have encountered some problems in the process of installing the environment ,so that I have not run your program successfully.

[hmer101]

@zzt007 if you continue to have issues, please post a detailed copy of the error log so I might be of more assistance. I would also recommend chapter 18 of this book as a good introduction to basic reinforcement learning concepts

[zzt007]

Copy Understood. Thanks！

[zzt007]

Hi , yesterday I tried to install all the requirements in my environment:

• WSL2 & Ubuntu18.04 Melodic
• python version: 3.6

I find that if follow your update_denpencies.sh to git clone the fssim.git , it will git clone the main branch , but we need the melodic branch , so I git clone it by myself.

and I encountered a problem when launch the roslaunch fssim_interface fssim.launch ,the error belike 👇：

But the package : Shapely has been installed in my python3. and I can import it successfully in my python3 environment. So I doubt it's the reason that Melodic does not support python3 . If you've encountered the same problem, please tell me how to solve it. Looking forward to your reply.

[hmer101]

I remember seeing a similar problem when I tried to install fssim myself but it was so long ago that I don't remember how I solved it off the top of my head sorry. It should be solvable by internet search and digging through the fssim repository. Are you using a python virtual environment? Using or not using that might change the outcome...

[zzt007]

I didn't use the python virtual environment. Thanks for your reply, I will try to search.