search

carla-simulator / carla

Open-source simulator for autonomous driving research.
http://carla.org
MIT License
11.11k stars 3.58k forks source link

Is it possible to use custom datasets in CARLA? #797

Closed anubhav0fnu closed 5 years ago

anubhav0fnu commented 5 years ago

Hello,

Is there a way we can give custom video dataset as input to CARLA and see how a self-driving car actually drives in the custom environment? The dataset could be real-world, such as BDD100K or Cityscapes.

I searching for an open-source simulator wherein I can plug-play a already trained self-driving car model and test it on different datasets to see how well the autonomous model performs.?

I didn't find a way to it using documentation.

marcgpuig commented 5 years ago

Hi @anubhav0fnu I'm not sure if I understand you. CARLA itself does not provide any car AI that you can use in any of these datasets. If you are planning to create and train an (external) agent with CARLA, then you will be able to use this agent to see how it drives using the dataset you want. But this last part is up to you, it has nothing to do with CARLA :)

Please clarify if I am wrong or I do not know other details.

Cheers.

anubhav0fnu commented 5 years ago

@marcgpuig , so, if I can create a self-driving agent by myself, is it possible to incorporate a real-world dataset in the simulator, for example, the one I mentioned above?

Romanenko-Serhii commented 5 years ago

@anubhav0fnu you need to create a map in Unreal Engine. So, it's steel will look like a game, not like a real world. https://carla.readthedocs.io/en/latest/map_customization/

marcgpuig commented 5 years ago

@anubhav0fnu What I can't understand is what do you mean with

incorporate a real-world dataset in the simulator

Do you mean another map like @Romanenko-Serhii suggested?

stale[bot] commented 5 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.