Del-S / WearFingerprint

WearFingerprint
1 stars 0 forks source link

Couchebase to SQL #16

Closed Del-S closed 6 years ago

Del-S commented 6 years ago

Try to avoid generating views.

Del-S commented 6 years ago

Time and data comparison for couchebase to SQL for 315 documents (whole database).

Type Time Data size
Couchebase with views - 30 offset 3.75 minutes 106 MB
Couchebase without views - 30 offset or no offset 2.11 minutes 46 MB
Couchebase without views - 30 offset + single transaction 1.90 minutes 46 MB

Note: Couche + SQL can have 46 MB but SQL only has around 15MB. Meaning that Couche takes 31MB+.

Speed test for parts of moving Couche to SQL:

Action Time
Download databse 0.60 minutes
Parse CoucheBase Documents 1.07 minutes
Inserting into SQL 0.43 minutes

Speed test of loading all 315 documents and all sub-documents:

Action Time
Loading from Couchebase 1.09 minutes
Loading from SQL 0.39 minutes
Del-S commented 6 years ago

Couchebase to SQL completed in: 525ce7c

Del-S commented 6 years ago

Download speeds of the server built for this application (Spring + couchbase connection):

Network load Api call type Time
Heavy 50 documents per run (n.1) 1.60 minutes
Heavy 50 documents per run (n.2) 1.48 minutes
Heavy 50 documents per run (n.3) 1.70 minutes
Light 50 documents per run (n.1) 0.95 minutes
Light 50 documents per run (n.2) 0.84 minutes
Light 50 documents per run (n.3) 0.91 minutes
Heavy 100 documents per run (n.1) 1.18 minutes
Heavy 100 documents per run (n.2) 1.11 minutes
Heavy 100 documents per run (n.2) 1.16 minutes
Light 100 documents per run (n.1) 0.76 minutes
Light 100 documents per run (n.2) 0.80 minutes
Light 100 documents per run (n.3) 0.82 minutes