Parallelize image creation and analyze session function calls

KenjiPcx / Microsoft-Imagine-Cup-2024-FeynmanLearn

https://delightful-beach-0f72d6303.4.azurestaticapps.net/

MIT License

1 stars 0 forks source link

Parallelize image creation and analyze session function calls #83

Open KenjiPcx opened 9 months ago

KenjiPcx commented 9 months ago

Issue details

In the analyze session endpoint, the gpt 4 request and the dall e + blob upload requests can definitely be parallelized using the async api
This should reduce the response time of the call by like 50%

KenjiPcx commented 9 months ago

The above can't be done, we get our image prompt from the llm call, but we might be able to move the image generation as a background task (ie make this function call another function and forget about it, search up fire and forget background jobs