scuttlebutt-eu / important-documents

https://scuttlebutt.eu/
7 stars 2 forks source link

Define good / hard problems we need to tackle to move ssb forward #39

Open arj03 opened 4 years ago

arj03 commented 4 years ago

Networking:

Messages / feed identity:

Partial replication:

Onboarding:

Blobs:

Private groups:

Pubs:

arj03 commented 4 years ago

Manyverse:

arj03 commented 4 years ago

The bug talk: https://hackmd.io/0Ks7oOT9THWyc887s0cfGw

arj03 commented 4 years ago

@staltz I noticed you wrote muxrpc-push-stream as in progress. Can you elaborate on that? I was testing push stream the other day and it appears to be quite a lot faster. What is your opinion on streams in general in ssb? Considering we don't have the-one-who-must-not-be-named to maintain pull/push stream?

arj03 commented 4 years ago

ARJ Onboarding, feed thoughts: https://github.com/arj03/ssb-new-format

staltz commented 4 years ago

@arj03 Unless my memory fails me, the-one-who-must-not-be-named said that muxrpc with push streams isn't ready yet. We could try checking with cryptix too, what he thinks about it.

elavoie commented 4 years ago

Can I be included on why the-one-who-must-not-be-named should not be? Is that to avoid spurious notifications? Or are there additional reasons (funny or not!)?

arj03 commented 4 years ago

It should be this. But yeah, status wise I think you are right. I found that out the hard way with flumelog-aligned-offset that was definitely not ready yet ;-) What I'm after here is that if we are going to change some of the fundamental things (like pull stream in js land) or muxrpc, then it might make more sense to use something that was not written by dominic (the-one-who-must-not-be-named) :) And I was interested in your thoughts on that Andre. The good thing about push stream though, as an example, is that it is a 1-1 mapping api wise with pull streams so super easy to change.

arj03 commented 4 years ago

I had a nice chat with Cryptix about this. We are going to draft up a document for a parallel network api that implements some of these ideas, mostly related to onboarding and partial replication.

arj03 commented 4 years ago

Added some links to relevant Earthstar documents. Note their model is sufficiently different from ours that the ideas cannot be used directly, but at least the discussions give some good overview of where some of the problems lie.