WallarooLabs / wally

Distributed Stream Processing
https://www.wallaroolabs.com
Apache License 2.0
1.48k stars 69 forks source link

Add multi-key input and output checking to master-crasher.sh #3087

Closed slfritchie closed 4 years ago

slfritchie commented 4 years ago

See the sample-env-vars.sh* files for suggested default values: 10 independent keys, A-J, enumerated by the MULTIPLE_KEYS_LIST environment variable. The sanity loop of master-crasher.sh will concatenate all sink outputs into a single ordered file, then extract only a single key, then verify that the output order for that key is exactly equal to a strict prefix of the input file.

Also: