search

hackathon-cli-recommendation / cli-recommendation

4 stars 5 forks source link

Use async http requests #48

Closed wangzelin007 closed 1 year ago

wangzelin007 commented 1 year ago

Add timing decorator to record the response time for GPT requests. Replace requests with httpx, because requests is a synchronous HTTP request library and is not compatible with async. Asynchronously execute the steps of getting embeddings and getting chunks to improve the cli endpoint response speed.

jsntcy commented 1 year ago

No description provided.

Please add more details in description, such as why do we need this change?