PJLab-ADG / LimSim

LimSim & LimSim++: Integrated traffic and autonomous driving simulators with (M)LLM support
https://pjlab-adg.github.io/LimSim/
GNU General Public License v3.0
344 stars 27 forks source link

can not connect to 127.0.0.1:2000 #24

Closed weizhou1991 closed 1 month ago

weizhou1991 commented 3 months ago

Hi there,

I meet a strange problem that, I used a docker pulled from carla as the server, and I tried the SUMO demo "python3 run_synchronization.py examples/Town04.sumocfg --sumo-gui" which works fine, however, I tried your "ExampleModel.py" , RuntimeError: time-out of 2000ms while waiting for the simulator, make sure the simulator is ready and connected to 127.0.0.1:2000, I read the code, I found the host and port are the same, I am so confused, did I make something wrong ? I really appreciate that you can help me out here. Thank you so much

Best,

Fdarco commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it.

weizhou1991 commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it.

Thank you so much for replying, What do you mean "process the Town04 road network" I did that for test the connection of co-sim for SUMO to see if SUMO works. Because I tried your LLM test code and I have nothing show up in my window, which I found the answer for one case, you suggeset to check does the co-simulation works or not.
After I check it, I found it does works, however, I still can not use ur code to connect carla. I really confused about that.

weizhou1991 commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it. image I followed this to test the SUMO co-simulation

weizhou1991 commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it.

Alright, I found out why, because my pc is not that good , needs more than 2000ms to load carla ... Thank you so much for your reply....

weizhou1991 commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it.

image Is it right that no prompt and message come out for "ExampleModel.py" ?

Fdarco commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it.

image Is it right that no prompt and message come out for "ExampleModel.py" ?

Yes, the prompt box won't have a message if you're not using MLLM for decision making.

Fdarco commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it. image I followed this to test the SUMO co-simulation

May I ask where you saw this documentation, we have not tested it on Town04 and there should be an error in the documentation. Please provide a link to this documentation and we will fix it.

weizhou1991 commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it. image I followed this to test the SUMO co-simulation

May I ask where you saw this documentation, we have not tested it on Town04 and there should be an error in the documentation. Please provide a link to this documentation and we will fix it.

https://carla.readthedocs.io/en/latest/adv_sumo/ here it is

weizhou1991 commented 3 months ago

Thanks for using LimSim++, I see you used the Town04 road network, did you process the Town04 road network yourself? Since we haven't seen the specifics of the road network you're using, there's no way to know what's wrong with it. image I followed this to test the SUMO co-simulation

May I ask where you saw this documentation, we have not tested it on Town04 and there should be an error in the documentation. Please provide a link to this documentation and we will fix it. Hi,

I got "ExampleModel.py" run great, however, when I tried " ExampleLLMAgentCloseLoop.py" I got this: image The output of terminl shows like this: image What kind of images can I have if it runs well? And could you give me a hit where I might be wrong for running your example ?

Best,

Fdarco commented 3 months ago

It is true that ExampleLLMAgentCloseLoop.py will not provide a front view image. If you want to see the front-view image, you should run ExampleVLMAgentCloseLoop.py

weizhou1991 commented 3 months ago

It is true that ExampleLLMAgentCloseLoop.py will not provide a front view image. If you want to see the front-view image, you should run ExampleVLMAgentCloseLoop.py

sounds like I should get a GPT4-V key to run it. DO I have any way to change the VLM to Qwen-VL or LLaVA, etc?

Fdarco commented 3 months ago

You can refer to our code to build a driver agent based on Qwen-VL, we don't provide this piece of code at the moment. Feel free to give us a PR if you have done this work.

github-actions[bot] commented 1 month ago

Stale issue message, no activity