hicommonwealth / commonwealth

A platform for decentralized communities
https://commonwealth.im
GNU General Public License v3.0
66 stars 40 forks source link

IPFS Rate Limiting #4925

Open timolegros opened 10 months ago

timolegros commented 10 months ago

Describe the bug

We load 300+ Aave proposals for the aave community, each of which requires an IPFS request to get the proposal title + body. After roughly 220 IPFS requests Cloudflare is rate limiting us. On the client this shows up as 500 errors because we proxy through Commonwealth but inspection of the response indicates a 429 Rate Limiting error.

To Reproduce

Load the aave community's proposals page and inspect the console/networks tab of the Chrome dev tools.

Expected behavior

IPFS data and/or proposals should load when scrolling rather than all at once.

Additional context

jnaviask commented 9 months ago

We could also include redis caching for the IPFS proxy as an alternative solution here.