We found that when a lot of sink writes happen concurrently through Executions using JobTest you can observe data race for Buffers of tuples created.
I've created a test to show this - if you do writes to 100 sinks in parallel it breaks internals of mutable map where we store tuple buffers for each mocked source and make test infinite.
We found that when a lot of sink writes happen concurrently through
Executions usingJobTestyou can observe data race forBuffers of tuples created.I've created a test to show this - if you do writes to 100 sinks in parallel it breaks internals of mutable map where we store tuple buffers for each mocked source and make test infinite.
I've added a lock to fix this race condition.