filecoin-station / spark

💥 Storage Provider Retrieval Checker as a Filecoin Station Module 🛰️
https://filspark.com
Other
8 stars 2 forks source link

HTTP retrievals only + more templates #12

Closed bajtos closed 11 months ago

bajtos commented 1 year ago

ETA: 2023-11-30

Earlier discussion about IPNI protocols: https://filecoinproject.slack.com/archives/C03PQG6UT2B/p1690560331187479

From https://github.com/multiformats/multicodec/blob/master/table.csv

name tag code status description
transport-ipfs-gateway-http transport 0x0920 draft HTTP IPFS Gateway trustless datatransfer
bajtos commented 1 year ago

We can get top 1000 CIDs from Saturn here: https://orchestrator.strn.pl/top-cids?limit=1000

bajtos commented 11 months ago

In Saturn's TOP 1000 CIDs, only web3.storage advertises HTTP protocol to IPNI. If we disabled protocols other than HTTP, then SPARK would become a checker for web3.storage only, which does not make sense to me. Let's keep testing all three protocols (bitswap, graph sync, http) for now.