filecoin-station / spark-api

💥 SPARK API
https://github.com/filecoin-station/spark
Other
3 stars 1 forks source link

Rework CID list to test HTTP protocol only #44

Closed juliangruber closed 11 months ago

juliangruber commented 1 year ago

via Will Scott:

to get a list of all HTTP-enabled SPs:

for a given cid:

via @bajtos:

I can see HTTP endpoints listed on IPNI website, the protocol is described as 0 or 2336. Example CID (hosted by DAG house, found in spark-api DB): bafybeiezeds576kygarlq672cnjtimbsrspx5b3tr3gct2lhqud6abjgiuz

See also: https://github.com/multiformats/multicodec/blob/master/table.csv

bajtos commented 1 year ago

I did most of the necessary work in https://github.com/filecoin-station/spark/issues/12.

We cannot switch to HTTP retrievals only, because for the CIDs in Saturn's TOP1000 CID list, only web3.storage advertises HTTP support.

Let's keep this issue open to remind us to remove non-http retrieval templates once we have a larger data set.

bajtos commented 11 months ago

spark-api work is done, spark-checker work continues here: