search

usail-hkust / LLMTSCS

Official code for article "LLMLight: Large Language Models as Traffic Signal Control Agents".
166 stars 21 forks source link

The operation seems to be stuck here #19

Open NearCai opened 6 months ago

NearCai commented 6 months ago

When calling an external large model, such as ChatGPT, it seems that the oneline file starts multithreading here, even if it is changed to another large model, it is useless.Especially the sentence between: for thread in tqdm(threads): thread.join()

屏幕截图 2024-05-09 113627 1
SQLai2099 commented 6 months ago

We do not use multi-threading when using other LLMs. If you would like to run open-sourced LLMs, you should refer to run_open_LLM.py. Thank you for the feedback.

NearCai commented 6 months ago

Thanks, but if I want to access the API interface of another model, what should I do? This problem occurs at this time

SQLai2099 commented 6 months ago

The HTTP request methods are provided differently across diverse service providers. You may need to re-write the request body by checking their official documents. However, I think multi-threading is still helpful in accelerating the requests.