search

cancergenetrust / cgtd

Decentralized distributed database of genomic and clinical data.
http://www.cancergenetrust.org
Apache License 2.0
40 stars 10 forks source link

Updating list of submissions via ipns publish is too slow #1

Closed rcurrie closed 8 years ago

rcurrie commented 8 years ago

Currently there is no way to get a list of all submissions. One option is to publish the list via ipns and update it on each submission. This will work as long as there is only a single node, but if a steward wants to run multiple mirrored daemons all with the same public/private key pair a more sophisticated eventually distributed append log will need be used such as https://github.com/haadcode/ipfs-log.

The other issue is a bit of a catch 22 in that we need determine if there is already an existing submissions list which if there isn't takes a very long time/just doesn't return.

rcurrie commented 8 years ago

https://github.com/ipfs/notes/issues/108 appears to a possible solution if/when implemented.

rcurrie commented 8 years ago

Edited issue title now that 87ff2a7253c0b3fc600c811d770f9c1b01595a4b adds a commit list via ipns publish. But this isn't really scalable due to the slow speed of ipns.

rcurrie commented 8 years ago

Submission list is going to be moved over to the Ethereum block chain so closing this as won't fix.

rcurrie commented 8 years ago

Switched back to ipns to keep things simpler. Already includes basic public/private key for authentication.