search

nsqio / go-diskqueue

A Go package providing a filesystem-backed FIFO queue
MIT License
464 stars 103 forks source link

asynchronous persistence #19

Closed Chaiyq closed 4 years ago

Chaiyq commented 4 years ago

In our application scenario, iot edge, there are many topics with a large amount of data, limited computer resources. Asynchronous persistence can improve processing power

Chaiyq commented 4 years ago

Asynchronous persistence can be independent of disk performance, which can be useful when there are many topics and large amounts of data. we are using nsq for MQ in many iot edge, thank you very much. @ploxiln

mreiferson commented 4 years ago

Hi @Chaiyq, thanks for your PR.

This package is designed "synchronously" on purpose, to provide back pressure if you cannot write to the disk fast enough. Now, there are probably things we could do to improve performance, but making it "asynchronous" is likely not something we will change.

Chaiyq commented 4 years ago

@mreiferson ，Thank you very much for your reply, best wishes.