search

acheong08 / ChatGPTProxy

Simple Cloudflare bypass for ChatGPT
The Unlicense
1.33k stars 325 forks source link

Is there anyway to bypass the proxy rate limit? #94

Open MichaelZhouwang opened 1 year ago

MichaelZhouwang commented 1 year ago

I want to use revChatGPT with multiple access tokens(without ChatGPT plus). Is there any way I can bypass the 5 request per 10 seconds rate limit for the proxy? For example, can I build my own proxy and set a higher rate limit? Or can I use an IP pool to use different IPs? Where exactly does this rate limit come from? Thanks!

acheong08 commented 1 year ago

For example, can I build my own proxy and set a higher rate limit

yes. the reason for rate limit is due to previous spam/abuse. I set it up so the server wont crash

MichaelZhouwang commented 1 year ago

Hey I'm not getting "too many requests in one hour" message even with many access tokens and my own proxy server. I think it's an IP-based rate limit. But it seems the proxy used in the revChatGPT repo is not limited by the same limitation. How should I bypass this limit? Thanks!

bi1101 commented 1 year ago

Can you be clearer?

I suspect the churchless server also use dynamic proxy in addition to the reverse proxy to by pass the IP rate limitation, considering they are a public server with tons of traffic

If you want to by pass the IP limit, you could use dynamic proxy too.

Can anyone confirm this?

acheong08 commented 1 year ago

_puid cookie

bi1101 commented 1 year ago

Hmm, I use puid (from plus account) on both the chat api and my own proxy too but still encounter some rate limit.

However, I didnot encounter any rate limit when I use the churchless bypass with the same puid.

In fact, I run the same spam test with both proxy and the churchless server but the churchless server has has way higher rate limit.

From my point of view, the only difference is the server IP or some fingerprints.

Do you have any idea why this is?

acheong08 commented 1 year ago

From my point of view, the only difference is the server IP or some fingerprints.

Probably server IP. The binary running on churchless is directly deployed from releases & built by GitHub actions without any changes

bi1101 commented 1 year ago

This is probably a dumb question but how exactly do you set the puid?

I tried setting it in the .env file and using the admin API but the limit per hour still happens even with plus account.

But when I use the proxy on bypass.churchless the limit is gone

This is really puzzling and since the latest update to the chat.openai.com endpoint we have to use reverse proxy to make calls so I don't want to put tons of load on the churchless server

acheong08 commented 1 year ago

I tried setting it in the .env file and using the admin API but the limit per hour still happens even with plus account.

Using the admin API should do it. Or PUID=<_puid cookie> ./ChatGPTProxy

It might or might not work. Not sure what is going on. bypass.churchless.tech is no longer using a valid PUID since I don't have a Plus account anymore but it continues to work