search

tud-hri / joan

JOAN is an software package that allows to perform human-in-the loop experiments in the open source driving simulator CARLA. JOAN facilitates communication between human input devices and CARLA, the implementation of haptic feedback, systematically storing experiment data, and the automatic execution of experiments with multiple experimental conditions.
Other
10 stars 7 forks source link

Unable to Load vehicle into Carla #32

Open srpn97 opened 4 months ago

srpn97 commented 4 months ago

I followed the documentation to install and JOAN, but I am not seeing DemoMap or the EpicAudi class in Unreal Editor. And Without adding epicAudi as the class for the new car, JOAN doesnt spawn a vehicle on start. I can see these files in explorer, but when I try to open Level > DemoMap, I cannot see anything, the folder is empty.

OlgerSiebinga commented 4 months ago

Hi @srpn97,

It sounds like the JOAN assets are not in the correct folders. The Demomap should be in the same folder as the other Carla levels. The same goes for the blueprints of the Audi. If they are in the right folder you should be able to add the Audi to the list of vehicles (step 2 in https://joan.readthedocs.io/en/develop/setup-joan/#adding-joan-assets). Did that step work for you?

srpn97 commented 4 months ago

In that step, I am not able to find BP_EpicAudi2 in the list. Right now I have files in this location carla\Unreal\CarlaUE4\Content\JOAN Assets I also tried putting the same assets in carla\Unreal\CarlaUE4\Content\Carla, basically merged with the existing folder structure of carla assets.

OlgerSiebinga commented 4 months ago

I you cannot find BP_EpicAudi2 in the list it means the files are not in the correct folder. You should copy everything inside the folder JOAN Assets to the folder carla\Unreal\CarlaUE4\Content\Carla. The internal folder structure of JOAN Assets should be the same as the internal structure of Carla, so all the subfolders should automatically be merged. (i.e., you're adding extra files to specific subfolders of the Carla folder. If you then restart the unreal editor you should be able to see BP_EpicAudi2 in the list.

srpn97 commented 4 months ago

I have another question, will not adding these effect JOAN? From JOAN HQ in carla interface settings I should be able to choose another vehicle and should be able to control the vehicle using the keyboard right? Are these two errors related? I am not able to spawn any vehicle right now through JOAN, but I was able to run manual_control.py in the example scripts with pygame.

OlgerSiebinga commented 4 months ago

I'm not completely sure if these are related. We do add some functionality to the player pawn with the JOAN assets. do you get an error message when you try to spawn a vehicle from JOAN?

srpn97 commented 4 months ago

I you cannot find BP_EpicAudi2 in the list it means the files are not in the correct folder. You should copy everything inside the folder JOAN Assets to the folder carla\Unreal\CarlaUE4\Content\Carla. The internal folder structure of JOAN Assets should be the same as the internal structure of Carla, so all the subfolders should automatically be merged. (i.e., you're adding extra files to specific subfolders of the Carla folder. If you then restart the unreal editor you should be able to see BP_EpicAudi2 in the list.

I did this, but still doesn't show up. Should I rebuild Python API? Coz the folder structure wasn't right when I first built Python API, then I realized my mistake and corrected the folder structure. I am able to to see DemoMap folder in UE Editor Content Browser, but it doesn't recognize any files in it.

srpn97 commented 4 months ago

I'm not completely sure if these are related. We do add some functionality to the player pawn with the JOAN assets. do you get an error message when you try to spawn a vehicle from JOAN?

It doesn't show any error, does not crash, but there is no vehicle spawn and no data collection. Its just in the running state until I stop.

OlgerSiebinga commented 4 months ago

I'm not completely sure if these are related. We do add some functionality to the player pawn with the JOAN assets. do you get an error message when you try to spawn a vehicle from JOAN?

It doesn't show any error, does not crash, but there is no vehicle spawn and no data collection. Its just in the running state until I stop.

Ok, in that case I think it's better to make a separate issue for this.

OlgerSiebinga commented 4 months ago

I you cannot find BP_EpicAudi2 in the list it means the files are not in the correct folder. You should copy everything inside the folder JOAN Assets to the folder carla\Unreal\CarlaUE4\Content\Carla. The internal folder structure of JOAN Assets should be the same as the internal structure of Carla, so all the subfolders should automatically be merged. (i.e., you're adding extra files to specific subfolders of the Carla folder. If you then restart the unreal editor you should be able to see BP_EpicAudi2 in the list.

I did this, but still doesn't show up. Should I rebuild Python API? Coz the folder structure wasn't right when I first built Python API, then I realized my mistake and corrected the folder structure. I am able to to see DemoMap folder in UE Editor Content Browser, but it doesn't recognize any files in it.

Yes, you could try re-running make launch and make pythonapi

srpn97 commented 4 months ago

I you cannot find BP_EpicAudi2 in the list it means the files are not in the correct folder. You should copy everything inside the folder JOAN Assets to the folder carla\Unreal\CarlaUE4\Content\Carla. The internal folder structure of JOAN Assets should be the same as the internal structure of Carla, so all the subfolders should automatically be merged. (i.e., you're adding extra files to specific subfolders of the Carla folder. If you then restart the unreal editor you should be able to see BP_EpicAudi2 in the list.

I did this, but still doesn't show up. Should I rebuild Python API? Coz the folder structure wasn't right when I first built Python API, then I realized my mistake and corrected the folder structure. I am able to to see DemoMap folder in UE Editor Content Browser, but it doesn't recognize any files in it.

Yes, you could try re-running make launch and make pythonapi

Thank you! I’ll try the whole setup again, and give an update here.

Thanks again for the quick response.

srpn97 commented 4 months ago

Hello again, I redid the whole setup, I still am facing the same issue. Joan assets are not showing up in Carla Unreal Editor. Can you share the exact version these assets were created with? I am using Unreal Engine version 4.24.3, which should be okay accoridng to the documentation. All other assets seem to work except DemoMap and BP_EpicAudi2.

Thank you!

OlgerSiebinga commented 4 months ago

Currently. there are two versions of JOAN, each with its own assets and dependencies. The version on the master branch is v1.1.0, the version on the develop branch is v1.2.0. This develop branch version is not really released yet because we experienced some weird behavior in initializing the sensodrive steeringwheels (sometimes you have to do that manually and sometimes not, nothing dangerous, just annoying). The corresponding version numbers are in the documentation, and the corresponding assets are available by switching the version in the 4TU data repository.

Which version of JOAN are you using?