Closed RaiAmanRai closed 1 year ago
Hey, I could not understand the part where/how you guys handle the ChatGPT API latency.
The responces take around 3-4 seconds which is significant. How is that handeled here. Would love to hear more on that.
we write about this in a blog post here. hope that helps!
davidzhao
commented
1 year ago
Hey, I could not understand the part where/how you guys handle the ChatGPT API latency.
The responces take around 3-4 seconds which is significant. How is that handeled here. Would love to hear more on that.