search

ai-se / ML-assisted-SLR

Automated Systematic Literature Review
2 stars 2 forks source link

Stats #52

Open azhe825 opened 7 years ago

azhe825 commented 7 years ago

Update an SLR

Hall2007- -> Hall2007+

POS vs All: Cliff's delta test: 0.089, trivial

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,   UPDATE_ALL ,    110.00  ,  10.00 (*              |              ), 100.00,  110.00,  110.00
   2 ,   UPDATE_POS ,    120.00  ,  10.00 ( *             |              ), 120.00,  120.00,  130.00
   3 ,     FASTREAD ,    225.00  ,  60.00 (         ---*  |              ), 200.00,  230.00,  260.00

Wahono2008- -> Wahono2008+

POS vs All: Cliff's delta test: 0.433, moderate

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,   UPDATE_POS ,    290.00  ,  30.00 ( *             |              ), 270.00,  290.00,  300.00
   1 ,   UPDATE_ALL ,    295.00  ,  40.00 ( -*            |              ), 270.00,  300.00,  310.00
   2 ,     FASTREAD ,    1080.00  ,  290.00 (               | ------*      ), 840.00,  1080.00,  1130.00

Danijel2005- -> Danijel2005+

POS vs All: Cliff's delta test: 0.02, trivial

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,   UPDATE_ALL ,    190.00  ,  40.00 ( *             |              ), 180.00,  190.00,  220.00
   2 ,   UPDATE_POS ,    230.00  ,  30.00 (  -*           |              ), 210.00,  230.00,  240.00
   3 ,     FASTREAD ,    445.00  ,  110.00 (         --*   |              ), 390.00,  450.00,  500.00

Reuse an SLR

Hall -> Wahono

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       Update ,    455.00  ,  140.00 ( ---*          |              ), 370.00,  470.00,  510.00
   1 , Update-reuse ,    480.00  ,  100.00 (   -*          |              ), 430.00,  490.00,  530.00
   2 ,        Reuse ,    600.00  ,  60.00 (      -*       |              ), 560.00,  600.00,  620.00
   3 ,        FASTREAD ,    730.00  ,  170.00 (        ---*   |              ), 630.00,  730.00,  800.00

Hall -> Danijel

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,        Reuse ,    445.00  ,  50.00 (  -*           |              ), 420.00,  450.00,  470.00
   1 , Update-reuse ,    450.00  ,  90.00 ( --*           |              ), 400.00,  450.00,  490.00
   2 ,       Update ,    470.00  ,  100.00 (   -*          |              ), 450.00,  470.00,  550.00
   3 ,        FASTREAD ,    615.00  ,  240.00 (       ---*    |              ), 530.00,  620.00,  770.00

Wahono -> Danijel

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,        Reuse ,    450.00  ,  50.00 (    -*         |              ), 440.00,  450.00,  490.00
   1 , Update-reuse ,    475.00  ,  70.00 (    ---*       |              ), 430.00,  480.00,  500.00
   2 ,       Update ,    555.00  ,  100.00 (         ---*  |              ), 510.00,  560.00,  610.00
   2 ,        FASTREAD ,    595.00  ,  150.00 (           ---*|              ), 550.00,  600.00,  700.00

Wahono -> Hall

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,        Reuse ,    290.00  ,  20.00 (  *            |              ), 280.00,  290.00,  300.00
   2 , Update-reuse ,    305.00  ,  40.00 (  --*          |              ), 280.00,  310.00,  320.00
   3 ,       Update ,    335.00  ,  70.00 (    --*        |              ), 310.00,  340.00,  380.00
   4 ,        FASTREAD ,    385.00  ,  150.00 (      ---*     |              ), 340.00,  390.00,  490.00

Danijel -> Hall

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,        Reuse ,    260.00  ,  20.00 (-*             |              ), 250.00,  260.00,  270.00
   2 , Update-reuse ,    320.00  ,  60.00 (  --*          |              ), 280.00,  320.00,  340.00
   3 ,       Update ,    355.00  ,  100.00 (    ---*       |              ), 320.00,  360.00,  420.00
   3 ,        FASTREAD ,    375.00  ,  130.00 (    ----*      |              ), 320.00,  380.00,  450.00

Danijel -> Wahono

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       Update ,    560.00  ,  100.00 (  ---*         |              ), 520.00,  560.00,  620.00
   1 ,        Reuse ,    560.00  ,  50.00 (   --*         |              ), 540.00,  560.00,  590.00
   1 , Update-reuse ,    570.00  ,  70.00 (   --*         |              ), 530.00,  570.00,  600.00
   2 ,        FASTREAD ,    690.00  ,  120.00 (          --*  |              ), 650.00,  690.00,  770.00

timm commented 7 years ago

do we suggest update-pos?

we could... based on the smaller memory size of that system. but i cant see a performance win

Do we suggest Update-reuse?

from the above, i think we can NOT suggest udpate. but its very minor between update-resuse vs reuse . is thre any systems reason, or usability reason to prefer the one you love?