ai-se / SMOTE

0 stars 0 forks source link

EXP2: experiment on binary classification #11

Closed WeiFoo closed 8 years ago

WeiFoo commented 8 years ago

EXP Settings

WeiFoo commented 8 years ago

Results

emac

rank ,                                          name ,    med   ,  iqr 
----------------------------------------------------
   1 ,                            NB_Naive_1000_helm ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                            NB_Naive_4000_helm ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                     NB_TunedLearner_4000_helm ,       0  ,    96 (*              |              ), 0.00,  0.00,  0.00,  0.96,  0.96
   1 ,                            NB_Naive_7000_helm ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                           NB_Naive_10000_helm ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   2 ,                      NB_TunedSmote_10000_helm ,      90  ,     3 (               |           *  ), 0.89,  0.90,  0.90,  0.93,  0.93
   2 ,                           NB_Smote_10000_helm ,      92  ,     0 (               |          --* ), 0.87,  0.92,  0.92,  0.92,  0.93
   2 ,                            NB_Smote_7000_helm ,      93  ,     2 (               |          --* ), 0.87,  0.91,  0.93,  0.93,  0.93
   2 ,                       NB_TunedSmote_4000_helm ,      93  ,     2 (               |           -* ), 0.90,  0.92,  0.93,  0.94,  0.94
   2 ,                       NB_TunedSmote_7000_helm ,      93  ,     0 (               |           -* ), 0.88,  0.93,  0.93,  0.93,  0.94
   2 ,                       NB_TunedSmote_1000_helm ,      94  ,     3 (               |             *), 0.92,  0.93,  0.94,  0.96,  0.96
   2 ,                            NB_Smote_4000_helm ,      94  ,     1 (               |           - *), 0.90,  0.94,  0.94,  0.95,  0.95
   2 ,                            NB_Smote_1000_helm ,      95  ,     1 (               |            -*), 0.92,  0.94,  0.95,  0.95,  0.96
   2 ,                     NB_TunedLearner_1000_helm ,      95  ,    95 (               |             *), 0.00,  0.00,  0.95,  0.95,  0.97
   2 ,                     NB_TunedLearner_7000_helm ,      95  ,    95 (               |             *), 0.00,  0.00,  0.95,  0.95,  0.96
   2 ,                    NB_TunedLearner_10000_helm ,      96  ,     0 (---------------|-------------*), 0.00,  0.96,  0.96,  0.96,  0.97
process 0 end: Dec 03 2015 00:51:32 

opendata

rank ,                                          name ,    med   ,  iqr 
----------------------------------------------------
   1 ,                   NB_Naive_1000_best-practice ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                   NB_Smote_1000_best-practice ,       0  ,    97 (*              |              ), 0.00,  0.00,  0.00,  0.97,  1.00
   1 ,              NB_TunedSmote_1000_best-practice ,       0  ,     0 (*--------------|------------- ), 0.00,  0.00,  0.00,  0.00,  0.99
   1 ,                   NB_Naive_4000_best-practice ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                   NB_Smote_4000_best-practice ,       0  ,     0 (*--------------|------------  ), 0.00,  0.00,  0.00,  0.00,  0.96
   1 ,              NB_TunedSmote_4000_best-practice ,       0  ,     0 (*--------------|------------  ), 0.00,  0.00,  0.00,  0.00,  0.95
   1 ,                   NB_Naive_7000_best-practice ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                   NB_Smote_7000_best-practice ,       0  ,     0 (*--------------|------------  ), 0.00,  0.00,  0.00,  0.00,  0.96
   1 ,              NB_TunedSmote_7000_best-practice ,       0  ,     0 (*--------------|------------- ), 0.00,  0.00,  0.00,  0.00,  0.97
   1 ,                  NB_Naive_10000_best-practice ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                  NB_Smote_10000_best-practice ,       0  ,     0 (*--------------|------------  ), 0.00,  0.00,  0.00,  0.00,  0.96
   1 ,             NB_TunedSmote_10000_best-practice ,       0  ,     0 (*--------------|------------- ), 0.00,  0.00,  0.00,  0.00,  0.97
   1 ,            NB_TunedLearner_4000_best-practice ,       0  ,     3 (*--------------|------------  ), 0.00,  0.00,  0.00,  0.03,  0.95
   1 ,            NB_TunedLearner_7000_best-practice ,       0  ,     1 (*              |              ), 0.00,  0.00,  0.00,  0.01,  0.03
   1 ,            NB_TunedLearner_1000_best-practice ,       2  ,     3 (*--------------|------------  ), 0.00,  0.00,  0.02,  0.03,  0.94
   1 ,           NB_TunedLearner_10000_best-practice ,       2  ,     3 (*--------------|------------  ), 0.00,  0.00,  0.02,  0.03,  0.94
process 0 end: Dec 02 2015 23:12:58 

softwarerecs

rank ,                                          name ,    med   ,  iqr 
----------------------------------------------------
   1 ,                             NB_Naive_1000_osx ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                             NB_Naive_4000_osx ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                      NB_TunedLearner_4000_osx ,       0  ,    93 (*              |              ), 0.00,  0.00,  0.00,  0.93,  0.96
   1 ,                             NB_Naive_7000_osx ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                      NB_TunedLearner_7000_osx ,       0  ,     0 (*--------------|------------- ), 0.00,  0.00,  0.00,  0.00,  0.94
   1 ,                            NB_Naive_10000_osx ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                     NB_TunedLearner_10000_osx ,       0  ,     0 (*--------------|------------- ), 0.00,  0.00,  0.00,  0.00,  0.95
   2 ,                            NB_Smote_10000_osx ,      88  ,     2 (               |          -*  ), 0.86,  0.87,  0.88,  0.89,  0.89
   2 ,                       NB_TunedSmote_10000_osx ,      88  ,     1 (               |           *  ), 0.88,  0.88,  0.88,  0.89,  0.90
   3 ,                             NB_Smote_1000_osx ,      90  ,     3 (               |            * ), 0.88,  0.88,  0.90,  0.91,  0.91
   3 ,                             NB_Smote_7000_osx ,      90  ,     1 (               |            * ), 0.88,  0.89,  0.90,  0.90,  0.91
   3 ,                        NB_TunedSmote_7000_osx ,      90  ,     0 (               |           -* ), 0.89,  0.90,  0.90,  0.90,  0.91
   4 ,                             NB_Smote_4000_osx ,      91  ,     1 (               |            * ), 0.89,  0.91,  0.91,  0.92,  0.92
   4 ,                        NB_TunedSmote_4000_osx ,      92  ,     0 (               |            * ), 0.91,  0.92,  0.92,  0.92,  0.93
   4 ,                      NB_TunedLearner_1000_osx ,      92  ,     1 (               |            * ), 0.91,  0.92,  0.92,  0.93,  0.93
   4 ,                        NB_TunedSmote_1000_osx ,      92  ,     2 (               |            * ), 0.91,  0.91,  0.92,  0.93,  0.94
process 0 end: Dec 03 2015 05:29:43 

windosphone

rank ,                                          name ,    med   ,  iqr 
----------------------------------------------------
   1 ,                             NB_Naive_1000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                             NB_Smote_1000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                        NB_TunedSmote_1000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                             NB_Naive_4000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                             NB_Smote_4000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                        NB_TunedSmote_4000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                             NB_Naive_7000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                             NB_Smote_7000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                        NB_TunedSmote_7000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                            NB_Naive_10000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                            NB_Smote_10000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                       NB_TunedSmote_10000_7.5 ,       0  ,     0 (*              |              ), 0.00,  0.00,  0.00,  0.00,  0.00
   1 ,                      NB_TunedLearner_4000_7.5 ,       0  ,     1 (*              |              ), 0.00,  0.00,  0.00,  0.01,  0.02
   1 ,                      NB_TunedLearner_1000_7.5 ,       1  ,     2 (*              |              ), 0.00,  0.00,  0.01,  0.02,  0.02
   1 ,                      NB_TunedLearner_7000_7.5 ,       1  ,     2 (*--------------|------------- ), 0.00,  0.00,  0.01,  0.02,  0.96
   1 ,                     NB_TunedLearner_10000_7.5 ,       1  ,     2 (*--------------|------------- ), 0.00,  0.00,  0.01,  0.02,  0.96
process 0 end: Dec 02 2015 23:05:58 

some data sets were killed and need more time to run:programmers, unix, webapps, webmasters some data sets have format issues and need to check: meta.magento, wordpress