harvard-edge / airlearning-ue4

Environment Generator for Air Learning Project. This version is build on top of UE4 game engine
37 stars 10 forks source link

Airlearning set up in Ubuntu 16.04 #2

Closed airopti closed 4 years ago

airopti commented 4 years ago

Is it possible to set up Airlearning in Ubuntu 16.04 ? When trying to compile Airlearning by Unreal in Ubuntu 16.04, I met lots of loading mistakes:

Is there anyway to fix these? Thanks so much.

srivatsankrishnan commented 4 years ago

Hi, unfortunately, we aren't feature complete on ubuntu yet. If you don't care about the domain randomization in your environment, then its fairly straight forward to get this up and running on ubuntu 16.04. Please email me and I can help you get started with running this on ubuntu.

The loading error you see is benign and it means these UE4 assets are not available in your project. You can safely ignore them. It doesn't affect the functionality and if you have those assets, these should go away. Some of the assets we used originally are purchased from the UE4 market place and hence can't openly distribute them. But thats why we designed the framework in such a way that depending upon your application, you can import assets/textures and materials specific to that.

airopti commented 4 years ago

Thanks so much. Hope Airlearning to be ready for Ubuntu.

srivatsankrishnan commented 4 years ago

Hi, I don't see any attachment. But I guess this issue is similar to https://github.com/harvard-edge/airlearning-rl/issues/1.

After installing the AirSim, you might need to run move.py script available in airlearning-rl repository. I have updated the instructions now (sorry, I never added that instruction in the first place). We had to change airsim client a little bit to enable domain randomization. If you run the script, I think you should be able to start the training process. If you run into any issue, let me know.

airopti commented 4 years ago

Sorry, I met a new problem. Now I can start the RL training process, but the training process will stop unexpected and restart Unreal Engine again. There is an error, "reset error, with cannot reshape array of size 110592 into shape (144,256,4) error" 2019-10-22 12-46-00屏幕截图

airopti commented 4 years ago

Sorry, I met a new problem. Now I can start the RL training process, but the training process will stop unexpected and restart Unreal Engine again. There is an error, "reset error, with cannot reshape array of size 110592 into shape (144,256,4) error" 2019-10-22 12-46-00屏幕截图

I rebuilt the AirSmi and now the whole system can work well ~

srivatsankrishnan commented 4 years ago

Just so that you know, there is a bug in Airsim (at least the version that we forked) where sometimes you get no response when you request for a state. This can crash the training. So in AirLearning, what we did was to catch the scenario and just restart everything (UE4 etc) and training will start from where it caught that error. This way we can run it for a longer time.