cboettig / neonstore

:package: A local content-based storage system for NEON data
https://cboettig.github.io/neonstore
Other
8 stars 5 forks source link

Pause when rate-limited #6

Closed cboettig closed 4 years ago

cboettig commented 4 years ago

neonstore now correctly detects when a request will incur rate limiting and pauses for the required amount.

Also, it appears there was a change in the NEON API to correct the issue about md5 sums being reported in a crc32 field. They are now reported correctly as md5, and thus we must patch neonstore to use the correct hash. (AOP products use the faster crc32 hash, others use md5).