search

trachten / cpisync

A library for synchronizing remote data with minimum communication.
GNU General Public License v3.0
26 stars 11 forks source link

OneWaySyncTest, LargeSyncTests, syncTime reporting fixed, benchmarks started, error calculation fix and various cleanups #37

Closed sean-brandenburg closed 5 years ago

sean-brandenburg commented 5 years ago

Most of the changes are fixes for things that were not working before or code cleanups. The new tests are the largeSync tests and the benchmarks.

sean-brandenburg commented 5 years ago

Also here are the results from a large sync I ran overnight

AuxiliaryTest::testStrTo : OK AuxiliaryTest::testToStr : OK AuxiliaryTest::testBase64_encode : OK AuxiliaryTest::testBase64_decode : OK AuxiliaryTest::testStrToVecToStr : OK AuxiliaryTest::testMultisetIntersect : OK AuxiliaryTest::testMultisetDiff : OK AuxiliaryTest::testMultisetUnion : OK AuxiliaryTest::testMultisetSubset : OK CPISyncTest::testCPIAddDelElem : OK CPISyncTest::CPISyncSetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Basic CPI Sync

Bytes Transmitted: 4134 Bytes Received: 2643 Sync Time(s): 1.98249

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Basic CPI Sync

Bytes Transmitted: 4134 Bytes Received: 2643 Sync Time(s): 1.99445

: OK CPISyncTest::CPISyncMultisetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Basic CPI Sync

Bytes Transmitted: 11654 Bytes Received: 7938 Sync Time(s): 3.37671

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Basic CPI Sync

Bytes Transmitted: 11094 Bytes Received: 8498 Sync Time(s): 3.2681

: OK CPISyncTest::CPISyncLargeSetReconcileTest

CLIENT RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Basic CPI Sync

Bytes Transmitted: 65590 Bytes Received: 40971 Sync Time(s): 5737.36

SERVER RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Basic CPI Sync

Bytes Transmitted: 65590 Bytes Received: 40971 Sync Time(s): 5774.65

: OK CPISyncTest::ProbCPISyncSetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Probabilistic CPI Sync

Bytes Transmitted: 4170 Bytes Received: 2652 Sync Time(s): 2.32727

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Probabilistic CPI Sync

Bytes Transmitted: 4170 Bytes Received: 2652 Sync Time(s): 2.38102

: OK CPISyncTest::ProbCPISyncMultisetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Probabilistic CPI Sync

Bytes Transmitted: 12074 Bytes Received: 8193 Sync Time(s): 3.76502

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Probabilistic CPI Sync

Bytes Transmitted: 11515 Bytes Received: 8753 Sync Time(s): 3.85497

: OK CPISyncTest::ProbCPISyncLargeSetReconcileTest CLIENT RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Probabilistic CPI Sync

Bytes Transmitted: 65642 Bytes Received: 40984 Sync Time(s): 6558.53 ^R

SERVER RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Probabilistic CPI Sync

Bytes Transmitted: 65642 Bytes Received: 40984 Sync Time(s): 7061.31

: OK CPISyncTest::testInterCPIAddDelElem : OK CPISyncTest::InterCPISyncSetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Interactive CPISync

Bytes Transmitted: 98 Bytes Received: 25 Sync Time(s): 0.003207

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Interactive CPISync

Bytes Transmitted: 98 Bytes Received: 25 Sync Time(s): 0.002802

: OK CPISyncTest::InterCPISyncMultisetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Interactive CPISync

Bytes Transmitted: 601 Bytes Received: 473 Sync Time(s): 0.021703

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Interactive CPISync

Bytes Transmitted: 585 Bytes Received: 489 Sync Time(s): 0.021264

: OK CPISyncTest::InterCPISyncLargeSetReconcileTest

CLIENT RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Interactive CPISync

Bytes Transmitted: 25470 Bytes Received: 18535 Sync Time(s): 17.7684

SERVER RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Interactive CPISync

Bytes Transmitted: 24526 Bytes Received: 19479 Sync Time(s): 17.4204

: OK CommSocketTest::GetSocketInfo : OK CommSocketTest::SocketSendAndReceiveTest : OK CommStringTest::testGetString : OK CommStringTest::testGetName : OK CommStringTest::testComm : OK CommunicantTest::testConstruct : OK CommunicantTest::testBytesAndResetCommCounters : OK CommunicantTest::testEstablishModAndCommZZ_p : OK CommunicantTest::testCommUstringBytes : OK CommunicantTest::testCommString : OK CommunicantTest::testCommLong : OK CommunicantTest::testCommUstringNoBytes : OK CommunicantTest::testCommDataObject : OK CommunicantTest::testCommDataObjectPriority : OK CommunicantTest::testCommDataObjectList : OK CommunicantTest::testCommDouble : OK CommunicantTest::testCommByte : OK CommunicantTest::testCommInt : OK CommunicantTest::testCommVec_ZZ_p : OK CommunicantTest::testCommZZ : OK CommunicantTest::testCommZZNoArgs : OK DataObjectTest::testToZZAndInitZZ : OK DataObjectTest::testToStringAndInitString : OK DataObjectTest::testToStringAndInitEmpty : OK DataObjectTest::testToCharArray : OK DataObjectTest::testPrint : OK DataObjectTest::testStreamInsertion : OK DataObjectTest::testLessThan : OK DataPriorityObjectTest::testToPriorityStringAndInitStringableAndSetPriority : OK DataPriorityObjectTest::testPriority : OK DataPriorityObjectTest::testTimeStamp : OK FullSyncTest::FullSyncSetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Full Sync Bytes Transmitted: 4487 Bytes Received: 5279 Sync Time(s): 0.008912

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Full Sync Bytes Transmitted: 3928 Bytes Received: 5279 Sync Time(s): 0.008339

: OK FullSyncTest::FullSyncMultisetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Full Sync Bytes Transmitted: 4488 Bytes Received: 5280 Sync Time(s): 0.009151

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with Full Sync Bytes Transmitted: 3928 Bytes Received: 5280 Sync Time(s): 0.008753

: OK FullSyncTest::FullSyncLargeSetReconcileTest

CLIENT RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Full Sync Bytes Transmitted: 62489 Bytes Received: 81894 Sync Time(s): 0.125792

SERVER RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with Full Sync Bytes Transmitted: 55231 Bytes Received: 81894 Sync Time(s): 0.124074

: OK FullSyncTest::testAddDelElem : OK FullSyncTest::testGetStrings : OK IBLTSyncTest::IBLTSyncSetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 49886 Bytes Received: 4640 Sync Time(s): 0.109935

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 49414 Bytes Received: 4496 Sync Time(s): 0.087285

: OK IBLTSyncTest::IBLTSyncMultisetReconcileTest

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 48301 Bytes Received: 2337 Sync Time(s): 0.068367

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 47878 Bytes Received: 2241 Sync Time(s): 0.06898

: OK IBLTSyncTest::IBLTSyncLargeSetReconcileTest

CLIENT RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 608239 Bytes Received: 69804 Sync Time(s): 1.1718

SERVER RECON STATS: Set of size 6240 with 5120 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 602485 Bytes Received: 72347 Sync Time(s): 1.13752

: OK IBLTSyncTest::testAddDelElem : OK IBLTSyncTest::testGetStrings : OK IBLTSyncTest::testIBLTParamMismatch

CLIENT RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 16 Bytes Received: 1 Sync Time(s): 0.000835

SERVER RECON STATS: Set of size 427 with 329 symmetric differences Stats for CommSocket syncing with IBLTSync

Bytes Transmitted: 16 Bytes Received: 1 Sync Time(s): 0.000821

: OK IBLTTest::testAll : OK OK (63)