feat: Simplify Barrage Viewport Table Updates - Githubissues

deephaven / deephaven-core

Deephaven Community Core

Other

257 stars 80 forks source link

feat: Simplify Barrage Viewport Table Updates #6347

Closed nbauernfeind closed 3 days ago

nbauernfeind commented 1 week ago

Fixes #6039. Fixes #6053.

The barrage viewport protocol has now changed:

viewports are never sent included rows; all added rows are included
added rows are position space from within the server-respected client requested viewport
removed rows are position space from within the server-respected client requested viewport
snapshots on viewports include removed rows to simplify client side processing
barrage update metadata now explicitly includes current table size; viewports no longer track the source table's full rowset

viewport clients must infer shifts:

removed rows are in pre-update space
added rows are in post-update space
the end-result viewport is retained rows + added rows (retained are the existing rows minus removed rows) where the adds are in the offsets specified by added rows

In this PR we'll bump the following dependencies:

flatbuffer from 1.12.0 to 24.3.25
arrow from 13.0.0 to 18.0.0
protobuf 3.25.3 to 3.25.4
barrage from 0.6.0 to 0.7.2 (noting that 0.7.x was released for this feature set)

deephaven-internal commented 3 days ago

Labels indicate documentation is required. Issues for documentation have been opened:

Community: https://github.com/deephaven/deephaven-docs-community/issues/362