The Row API is a typed interface for reading and writing topic data one row at a time.
Motivation
Currently data in synapse is sent and received as record batches. This works well for some use cases, but since synapse is intended to be a streaming datastore many of the use cases are going to be row-oriented. In particular, publishers are usually going to be sending one row at a time.
With the current design, this means that publishers have to either send data in batches of 1 (which is inefficient) or manually implement batching prior to writing to synapse.
Overview
The Row API is a typed interface for reading and writing topic data one row at a time.
Motivation
Currently data in synapse is sent and received as record batches. This works well for some use cases, but since synapse is intended to be a streaming datastore many of the use cases are going to be row-oriented. In particular, publishers are usually going to be sending one row at a time.
With the current design, this means that publishers have to either send data in batches of 1 (which is inefficient) or manually implement batching prior to writing to synapse.