FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
30.86k stars 16.06k forks source link

multithreading request Prediction API to achieve concurrent operations #2995

Closed Yakiw closed 2 months ago

Yakiw commented 2 months ago

Can I use multithreading to request the Prediction API of Flowise to achieve concurrent operations?

Although I used multithreading in Python, I saw that another request was made after one request was completed in the background.

HenryHengZJ commented 2 months ago

yeah but is up to the implementation on your python side to do the multithreading, flowise API by default is just an Node Express API. Moving to discussion