numberscope / backscope

Numberscope's back end: responsible for getting sequences and other data from the On-Line Encyclopedia of Integer Sequences, pre-processing it (factoring etc), and storing it.
MIT License
1 stars 9 forks source link

Error: You are crawling too fast. Please come back in a few minutes #34

Open gwhitney opened 2 years ago

gwhitney commented 2 years ago

The OEIS servers can generate this when the backend is bombarding it with too many requests. Instead of just bailing out when this error occurs, backscope should recognize the error and cool it for a while. We want to be polite users of the OEIS.

gwhitney commented 1 year ago

Not only that, but with extracting backrefs of for example A00005 that has 4,381 of them, it seems this crashes the server and/or more or less permanently prevents the sequence from being stored...