Instead of blocking scraping, can't we just put a limit on it?

mikedilger / chorus

Chorus is a nostr relay

Other

40 stars 7 forks source link

Instead of blocking scraping, can't we just put a limit on it? #19

Open fiatjaf opened 3 months ago

fiatjaf commented 3 months ago

The allow_scrape_if_limited_to requires a limit to be specified, but we'll never get clients to adhere to such requirements.

Instead why not have an option to impose a hard limit on scraping queries (or on all queries even) So if someone requests all our events we can just return the last 50 or something.

mikedilger commented 3 months ago

Interesting. I'm torn though.

I don't want to return results that I know are incorrect (incomplete), I'd rather return an error saying we can't fulfill the request.

mikedilger commented 2 months ago

Maybe we could have a config that specifies a max age, and then allow scrapes (backwards in time) up to the max age.