caching of head requests - Githubissues

filecoin-saturn / L1-node

Filecoin Saturn L1 Node • The edge cache layer of Filecoin's decentralized CDN 🪐

Other

140 stars 49 forks source link

caching of head requests #241

Open willscott opened 1 year ago

willscott commented 1 year ago

Right now, the stated plan from bifrost-gateway is that:

curl -X HEAD ipfs.io/ipfs/<cid>/path/to/data → curl -X GET saturn.tld/ipfs/<cid>/path/to/data?format=car&bytes=0:1023

lassie expects to ignore the bytes=0:1023 range request portion of the query, so you'll end up with lassie returning (in a streaming way) the full car file of result.
it may well be worth caching the full object at nginx - it's likely that the next request will be for most of it.
it may be worth investigating if there's a way that's possible to do that while only returning a truncated version of the response back to the caller

guanzo commented 1 year ago

Should be handled by https://github.com/filecoin-saturn/nginx-car-range