search

livepeer / go-PPSPP

Go implementation of the Peer-to-Peer Streaming Peer Protocol (rfc7574)
MIT License
11 stars 4 forks source link

PPSPP Reader / Writer for Data Translation #19

Open ericxtang opened 7 years ago

ericxtang commented 7 years ago

PPSPP assumes arbitrary data input format, and uses 1024 data chunks internally. We should have a tool for easy data deconstruction/reconstruction.

A generic data serializer / deserializer can be used for this. You can put any object into the serializer, and it'll take care of breaking the data down into PPSPP chunks (or constructing PPSPP chunks from smaller data pieces). Also, you can put PPSPP chunks into the deserializer and get data out.

This can be used as a tool to implement the Broadcaster/Subscriber interface in go-livepeer.

dob commented 7 years ago

One side effect of this is that if we do want the receiver to be able to reconstitute some intermediate state (such as a Livepeer segment), then the DATA portion of the data message would need to contain some metadata to allow it to do so. One option would be a header that contains the segment

, seq# of which datagram in the segment this is, and the total # of

datagrams for this segment. Another option would just be including a start datagram# and end datagram#. Finally, we could just include some indicator in the data itself that this segment is complete...but if you don't know when it started then you could run into trouble if you miss the end datagram of the previous segment.

On Fri, Jul 7, 2017 at 1:00 PM, Eric Tang notifications@github.com wrote:

PPSPP assumes arbitrary data input format, and uses 1024 data chunks internally. We should have a tool for easy data deconstruction/reconstruction.

A generic data serializer / deserializer can be used for this. You can put any object into the serializer, and it'll take care of breaking the data down into PPSPP chunks (or constructing PPSPP chunks from smaller data pieces). Also, you can put PPSPP chunks into the deserializer and get data out.

This can be used as a tool to implement the Broadcaster/Subscriber interface in Golp.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/livepeer/go-PPSPP/issues/19, or mute the thread https://github.com/notifications/unsubscribe-auth/AAAolejsV_l6vbSzrKb7_uXAtHfLh9STks5sLmRGgaJpZM4ORMUQ .