search

cg-dot / vertexai-cf-workers

Vertex AI (GCP) Claude Proxy via Cloudflare workers
617 stars 96 forks source link

‌ When there is a lot of contextual content in a conversation, incomplete responses may occur. #11

Open joeaki1983 opened 3 months ago

joeaki1983 commented 3 months ago

image image

As shown in the image, when there is a lot of context in a conversation, incomplete responses often occur. How can this issue be resolved?

cg-dot commented 3 months ago

I haven't been able to reproduce this issue on my end. It could be kind of network issue on your end. You might be able to find more details in your logs to further investigate the cause of this issue.

joeaki1983 commented 3 months ago

I haven't been able to reproduce this issue on my end. It could be kind of network issue on your end. You might be able to find more details in your logs to further investigate the cause of this issue.

Logs? Are you referring to the client-side logs?

cg-dot commented 3 months ago

Logs? Are you referring to the client-side logs?

Yes, there might be details in the logs of the client you're using.

joeaki1983 commented 3 months ago

Logs? Are you referring to the client-side logs?

Yes, there might be details in the logs of the client you're using.

I figured it out. It's because Cloudflare limits the performance for free users, and my usage intensity was too high.