search

talhaanwarch / doc_chat

Create a production level scalable chat bot to respond from the fed data
https://gptdemo.talhaanwar.com/
1 stars 0 forks source link

Donot load offline model in each request #29

Open talhaanwarch opened 1 year ago

talhaanwarch commented 1 year ago

https://stackoverflow.com/questions/71613305/how-to-process-requests-from-multiiple-users-using-ml-model-and-fastapi

https://github.com/tiangolo/fastapi/issues/3360