search

ipfs-inactive / archives

[ARCHIVED] Repo to coordinate archival efforts with IPFS
https://awesome.ipfs.io/datasets
182 stars 24 forks source link

Making sure archives are fetchable #177

Open victorb opened 5 years ago

victorb commented 5 years ago

To make sure all archives are still online and can be fetched, I'm currently running through them with refs -r.

victorb commented 5 years ago

These seems dead, can only get the listing of first level links but gets no further:

ghost commented 5 years ago

cdn.media.ccc.de | /ipfs/QmW84mqTYnCkRTy6VeRJebPWuuk8b27PJ4bWm2bL4nrEWb (@lgierth )

This one is also currently dead since it lives on a node whose badger datastore became unbootable. Working with the badger people to fix it.

eminence commented 5 years ago

Is this just to get a report? Or do you intend on pinning this stuff on protocol-labs hardware?

ghost commented 5 years ago

Mostly it's just to weed out things that went MIA, before DWeb Summit

kevina commented 5 years ago

Although it might not apply here, note that refs -r may not fetch the leaves if they are raw.

ghost commented 5 years ago

Oh what

ghost commented 5 years ago

But raw leaves can have references in them? Think about Git objects and the like

kevina commented 5 years ago

But raw leaves can have references in them?

No they can't. They are raw data with no structure and a leaf in the DAG tree. They by definition can not have links.

Think about Git objects and the like

I need examples.

ghost commented 5 years ago

Should add these existing archives to index.html and the datasets section of awesome-ipfs:

ghost commented 5 years ago

They're all added/removed in #178

h1z1 commented 5 years ago

Think this is the right place, heads up the example given to try is also MIA. Can't fetch it all from cloudflare either.

Arxiv.org CC-By Papers: https://ipfs.io/ipfs/QmfXH9XtP7xmoTH8WAp4HNSduqWMwLTH8B8TvbTkdgzNAa/