search

IBM / data-broker

The Data Broker (DBR) is a distributed, in-memory container of key-value stores enabling applications in a workflow to exchange data through one or more shared namespaces. Thanks to a small set of primitives, applications in a workflow deployed in a (possibly) shared nothing distributed cluster, can easily share and exchange data and messages with a minimum effort. In- spired by the Linda coordination and communication model, the Data Broker provides a unified shared namespace to applications, which is independent from applications’ programming and communication model.
Apache License 2.0
19 stars 23 forks source link

fixing directory call returned incomplete/incorrect data #91

Closed lasch closed 5 years ago

lasch commented 5 years ago

We discovered that the directory() call returns either incomplete or duplicate data when attempting to return more than 1000 records per Redis server.

The problem was the misuse of the unused user key ptr by multiple cursors at the same time. Therefore the cursor information of N-1 servers got lost and the wrong data was returned.

The fix uses a dedicated cursor ptr in the request status field, so that collisions are avoided.

lasch commented 5 years ago

Hold review for a moment. There's one of the tests failing that needs to be fixed...

lasch commented 5 years ago

ready for review now