Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.
Our current MySQL replication flow can be improved to process replication events faster. I Propose we do the following:
Group events from the same transaction and dispatch them as a batch to Readyset. Currently we read one event and dispatch a single event. We should take into consideration compressed events.
Pass table_filter object to replicator and skip events as soon as we read them. Currently we build the whole TableOperation and only discard the event in the noria code.
Description
Our current MySQL replication flow can be improved to process replication events faster. I Propose we do the following:
TableOperationand only discard the event in the noria code.Change in user-visible behavior
Requires documentation change