paypal / squbs

Akka Streams & Akka HTTP for Large-Scale Production Deployments
http://paypal.github.io/squbs
Apache License 2.0
1.43k stars 237 forks source link

Create PersistentQueueAppender and PersistentQueueSource #210

Open akara opened 8 years ago

akara commented 8 years ago

This is complementary to PersistentBuffer allowing persistent queue separation into two streams on potentially two different processes.

akara commented 8 years ago

Referencing review comments on #208:

Should we have a separate source and sink shape instead of flow shape? IMO, these two are complementary. The flow shape keeps the flow declaration simple and easy to understand. The separate source/sink shape is more flexible and can even be used for IPC between two flows in two different JVMs. I'll file an issue to create a source shape. As for sink shape, I'd prefer it to be a write stage (flow shape). This would allow easy building of a composite sink which materializes to a value of choice, rather than having a fixed sink that materializes to NotUsed.