guardstrikelab / carla_apollo_bridge

This project aims to provide a data and control bridge for the communication between the latest version of Apollo and Carla.
Apache License 2.0
320 stars 93 forks source link

Car doesn't move neither in Dreamview nor in Carla #102

Open PhilWallace opened 1 year ago

PhilWallace commented 1 year ago

Hello there. I built up all the dockers according to the doc. However, the car just does not move after I sent the routing request.

Here is the dreamview screen:

Screenshot from 2023-05-25 10-21-02

It seems that the control, planning some other channels are missing the messages.

And here's the screen of modules:

Screenshot from 2023-05-25 10-25-08

I noticed that some modules failed to start after I click the Setup in Tasks (including perception, prediction, traffic light ...). I also tried Manually start these modules, or use cyber_launch in terminal. But does't work.

According to the output of cyber_monitor, many channels are not actively receiving messages:

Screenshot from 2023-05-25 10-21-19

However, the routing module seems to work properly: the red line can be produced correctly in Dreamview. But the planning and control modules just won't work and my car is not moving.

I tried to switch to older modules, but still doesn't work. This problem really bothers me...

Hope I could get some advice here. Thanks in advance.

WilliaJing commented 1 year ago

The green planning trajectory has not been generated yet. After you click Setup, you can wait about 10 seconds. Sometimes the trajectory may be slow. In addition, some modules are indeed a problem. We are improving, welcome you to pull request.

fpeanut commented 1 year ago

@PhilWallace 车不动的问题解决了吗,我们也遇到类似的问题

PhilWallace commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview:

Screenshot from 2023-05-26 01-43-37

All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation:

Screenshot from 2023-05-26 01-48-28

What I did:

The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

PhilWallace commented 1 year ago

@PhilWallace 车不动的问题解决了吗,我们也遇到类似的问题

能动了,看下面的评论。但是控制性能感觉有点差,过弯有时候会卡住动不了。

WilliaJing commented 1 year ago

It looks like this issue hasn’t been active in longer than a few weeks. In the absence of more information, we will close it, If you find that this is still a problem, please feel free to reopen it.

Michael-Fuu commented 1 year ago

Hi there, I met the same problem and tried the methods mentioned before, first select the --vehicle-- in dreamview to Mkz Example. However, control, planning, prediction modules still not work, or sometimes wait for about ten mins to work, is there some ways or solutions to solve this?

PhilWallace commented 1 year ago

Hi there, I met the same problem and tried the methods mentioned before, first select the --vehicle-- in dreamview to Mkz Example. However, control, planning, prediction modules still not work, or sometimes wait for about ten mins to work, is there some ways or solutions to solve this?

By not working, do you mean you cannot launch these modules:

image

Or you can launch the modules, but the car won't move?

For me, the car won't move until I manually turned on the Prediction module. Sometimes I would still need to try multiple times for it to work.

Michael-Fuu commented 1 year ago

Hi there, I met the same problem and tried the methods mentioned before, first select the --vehicle-- in dreamview to Mkz Example. However, control, planning, prediction modules still not work, or sometimes wait for about ten mins to work, is there some ways or solutions to solve this?

By not working, do you mean you cannot launch these modules:

image

Or you can launch the modules, but the car won't move?

For me, the car won't move until I manually turned on the Prediction module. Sometimes I would still need to try multiple times for it to work.

I can launch these modules, but in Tasks menu I can't obtain info of control, planning, prediction.However when I wait some minutes, the control, plannig, prediction may work, or may not. I also usually have to try multiple times and wait a long time.

WilliaJing commented 1 year ago

you can try to restart bridge.py

Michael-Fuu commented 1 year ago

you can try to restart bridge.py I tried but still need to wait some mins to load planning, I also met the problem mentioned before, that the car won't move until I manually turned on the Prediction module. Sometimes I would still need to try multiple times for it to work.

PhilWallace commented 1 year ago

you can try to restart bridge.py I tried but still need to wait some mins to load planning, I also met the problem mentioned before, that the car won't move until I manually turned on the Prediction module. Sometimes I would still need to try multiple times for it to work.

Same for me. I usually need to restart the "Prediction" module for about 2~3 times, until the Module Delay information is normal, and then the car can move.

There is a similar issue: https://github.com/guardstrikelab/carla_apollo_bridge/issues/101. He solved this by running on a better environment (3090).

I'am running on a laptop of 12th i5 cpu + 3060 gpu. I don't know whether the performance of the computer would lead to this problem or not.

Michael-Fuu commented 1 year ago

you can try to restart bridge.py I tried but still need to wait some mins to load planning, I also met the problem mentioned before, that the car won't move until I manually turned on the Prediction module. Sometimes I would still need to try multiple times for it to work.

Same for me. I usually need to restart the "Prediction" module for about 2~3 times, until the Module Delay information is normal, and then the car can move.

There is a similar issue: #101. He solved this by running on a better environment (3090).

I'am running on a laptop of 12th i5 cpu + 3060 gpu. I don't know whether the performance of the computer would lead to this problem or not.

yes, I check the issue: #101.It seems that it's the same problem. Thank you for your quick reply!

zzx568730371 commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview:

Screenshot from 2023-05-26 01-43-37

All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation:

Screenshot from 2023-05-26 01-48-28

What I did:

The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

hi,i have met the same issue .i notice that you have run bridge.py and carla_spawn_objects.py . i knew where carla_spawn_objects.py is ,but i couldn't find bridge.py? i don't find any python file called 'bridge.py'

Michael-Fuu commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview: Screenshot from 2023-05-26 01-43-37 All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation: Screenshot from 2023-05-26 01-48-28 What I did: The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

hi,i have met the same issue .i notice that you have run bridge.py and carla_spawn_objects.py . i knew where carla_spawn_objects.py is ,but i couldn't find bridge.py? i don't find any python file called 'bridge.py'

you can change the github code version, as the newest version remove the bridge.py and instead, using main.py to work as bridge and spawn object.

zzx568730371 commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview: Screenshot from 2023-05-26 01-43-37 All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation: Screenshot from 2023-05-26 01-48-28 What I did: The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

hi,i have met the same issue .i notice that you have run bridge.py and carla_spawn_objects.py . i knew where carla_spawn_objects.py is ,but i couldn't find bridge.py? i don't find any python file called 'bridge.py'

you can change the github code version, as the newest version remove the bridge.py and instead, using main.py to work as bridge and spawn object.

OK,i was using the newest code version .but i my ego car still don't move after i choosing the vehicle to MKZ example and then ran the main.py, chosen the interest point , have you solve the problem?

zzx568730371 commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview: Screenshot from 2023-05-26 01-43-37 All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation: Screenshot from 2023-05-26 01-48-28 What I did: The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

hi,i have met the same issue .i notice that you have run bridge.py and carla_spawn_objects.py . i knew where carla_spawn_objects.py is ,but i couldn't find bridge.py? i don't find any python file called 'bridge.py'

you can change the github code version, as the newest version remove the bridge.py and instead, using main.py to work as bridge and spawn object.

OK,i was using the newest code version .but i my ego car still don't move after i choosing the vehicle to MKZ example and then ran the main.py, chosen the interest point , have you solve the problem?

XiaoFei9704 commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview: Screenshot from 2023-05-26 01-43-37 All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation: Screenshot from 2023-05-26 01-48-28 What I did: The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

hi,i have met the same issue .i notice that you have run bridge.py and carla_spawn_objects.py . i knew where carla_spawn_objects.py is ,but i couldn't find bridge.py? i don't find any python file called 'bridge.py'

you can change the github code version, as the newest version remove the bridge.py and instead, using main.py to work as bridge and spawn object.

OK,i was using the newest code version .but i my ego car still don't move after i choosing the vehicle to MKZ example and then ran the main.py, chosen the interest point , have you solve the problem?

The master branch has just updated the code, you can try again

zzx568730371 commented 1 year ago

Finally the car can move simultaneously in Dreamview and Carla. Here's the screen shot of dreamview: Screenshot from 2023-05-26 01-43-37 All modules in Module Delay seems to work properly. Still, some modules cannot be launched, but does not affect current co-simulation: Screenshot from 2023-05-26 01-48-28 What I did: The only difference operation I did to make it work, is to first select the --vehicle-- in dreamview to Mkz Example, and then execute the bridge.py and carla_spawn_objects.py. I guess it is because the vehicle module must first be loaded in dreamview, so that it can be read by the bridge. But I'm not sure.

hi,i have met the same issue .i notice that you have run bridge.py and carla_spawn_objects.py . i knew where carla_spawn_objects.py is ,but i couldn't find bridge.py? i don't find any python file called 'bridge.py'

you can change the github code version, as the newest version remove the bridge.py and instead, using main.py to work as bridge and spawn object.

OK,i was using the newest code version .but i my ego car still don't move after i choosing the vehicle to MKZ example and then ran the main.py, chosen the interest point , have you solve the problem?

The master branch has just updated the code, you can try again

Now it works! thanks a lot !

LCaptainJackSparrow commented 1 year ago

The vehicle still doesn't move in carla or in dreamview, after I made the following settings:

  1. clone the new apollo v8.0.0 and carla_apollo_bridge
  2. select the --vehicle-- in dreamview to Mkz Example
  3. open the localization ( I change MSF to RTK In apollo/modules/dreamview/conf/hmi_modes/mkz_standard_debug.pb.txt), planning, control, routing modules, and set up a new route.
  4. The docker output 'Could not create log file: Permission denied COULD NOT CREATE LOGFILE '20230907-172018.14054'' in apollo docker.
  5. I ran "sudo python main.py" in Apollo Docker, I reported an error of 'ModuleNotFoundError: No module named' carla'.
  6. I ran 'pip insatll carla ' and it was prompted that Carla has been installed. May I ask what caused this? Looking forward to a reply

2023-09-07 17-46-37屏幕截图 2023-09-07 17-54-59屏幕截图

XiaoFei9704 commented 1 year ago

@LCaptainJackSparrow Do not run "sudo python main.py", instead "python main.py". Besides, you can " mkdir /apollo/log" by yourself to avoid the 4th problem.

LCaptainJackSparrow commented 1 year ago

Thank you for your quick reply. A new log can be generated in the apollo/data/log directory. The planned trajectory has been generated, but the vehicle does not move either. I don't know what caused it. 2023-09-12 16-57-01屏幕截图

PhilWallace commented 11 months ago

Thank you for your quick reply. A new log can be generated in the apollo/data/log directory. The planned trajectory has been generated, but the vehicle does not move either. I don't know what caused it. 2023-09-12 16-57-01屏幕截图

You can try close the 'Control' module and start this module again.

LCaptainJackSparrow commented 11 months ago

Thank you for your reply. The car can move now.

wqklihbf commented 6 months ago

@PhilWallace Hi, I want to know how you manage to get the Localization on dreamview to show as OK, mine always shows error or warn. If you could give me some advice, I would really appreciate it.

PhilWallace commented 6 months ago

@PhilWallace Hi, I want to know how you manage to get the Localization on dreamview to show as OK, mine always shows error or warn. If you could give me some advice, I would really appreciate it.

What do you mean by 'always shows error or warn' ? Normally, if the co-simulation is correctly set up, you can click the 'Localization' in Modules window, and it can be started. What about your other modules? Does your Routine, Planning, or Control work normally?

wqklihbf commented 6 months ago

@PhilWallace Hi, I want to know how you manage to get the on to show as , mine always shows or . If you could give me some advice, I would really appreciate it.Localization``dreamview``OK``error``warn

What do you mean by 'always shows or ' ? Normally, if the co-simulation is correctly set up, you can click the 'Localization' in Modules window, and it can be started. What about your other modules? Does your Routine, Planning, or Control work normally?error``warn

很抱歉这么晚才回复。 2024-02-29 16-19-03 的屏幕截图 2024-02-29 16-18-49 的屏幕截图 这是我的dreamview界面,你可以看到LocalizationERROR。我使用cyber_monitor查看数据通道信息后,发现msf_gnss, msf_lidar, msf_status都是红色。

PhilWallace commented 6 months ago

@PhilWallace Hi, I want to know how you manage to get the on to show as , mine always shows or . If you could give me some advice, I would really appreciate it.LocalizationdreamviewOKerrorwarn

What do you mean by 'always shows or ' ? Normally, if the co-simulation is correctly set up, you can click the 'Localization' in Modules window, and it can be started. What about your other modules? Does your Routine, Planning, or Control work normally?errorwarn ``

很抱歉这么晚才回复。 2024-02-29 16-19-03 的屏幕截图 2024-02-29 16-18-49 的屏幕截图 这是我的dreamview界面,你可以看到LocalizationERROR。我使用cyber_monitor查看数据通道信息后,发现msf_gnss, msf_lidar, msf_status都是红色。

你试一下把相关的modules都打开,然后试试在tasks->others里打开camera sensor?

你是一定要msf的数据吗?从截图看来你的车也已经能跑了

如果还是不行,建议你查看log文件,看看具体报错信息,对应再去看源码debug

wqklihbf commented 6 months ago

@PhilWallace Hi, I want to know how you manage to get the on to show as , mine always shows or . If you could give me some advice, I would really appreciate it.dreamviewerrorLocalization``OK``warn

What do you mean by 'always shows or ' ? Normally, if the co-simulation is correctly set up, you can click the 'Localization' in Modules window, and it can be started. What about your other modules? Does your Routine, Planning, or Control work normally?warn `` error

很抱歉这么晚才回复。 2024-02-29 16-19-03 的屏幕截图 2024-02-29 16-18-49 的屏幕截图 这是我的dreamview界面,你可以看到是。我使用查看数据通道信息后,发现, , 都是红色。Localization``ERROR``cyber_monitor``msf_gnss``msf_lidar``msf_status

你试一下把相关的modules都打开,然后试试在tasks->others里打开camera sensor?

你是一定要msf的数据吗?从截图看来你的车也已经能跑了

如果还是不行,建议你查看log文件,看看具体报错信息,对应再去看源码debug

好的,谢谢你的建议,我之后会试试的。