search

serai-dex / serai

Other
266 stars 49 forks source link

Re-design processor/coordinator interactions #565

Open kayabaNerve opened 7 months ago

kayabaNerve commented 7 months ago

The current message queue is an interactive ordered process not amenable to rebuilding one but not both.

Interactions should be designed as an append-only series of data blobs queriable at any time in a way either can successfully be rebuilt. This would also parallelize the ordering, improving performance and preventing the risk of deadlocks.

kayabaNerve commented 7 months ago

I'm unsure we can get to this prior to mainnet :///

kayabaNerve commented 2 months ago

processor-smash is premised on reading from the message-queue, then internally dispatching without locks/blocking yet queueing. It accordingly doesn't mean this issue would improve performance, and has already resolved the deadlock concerns.

The ability to rebuild remains its own active question.