Closed WeiFoo closed 8 years ago
gogogoogogo auc Naive_CART Running Time: 0.0012 Tuned_CART Running Time: 0.1152 Grid_CART Running Time: 0.6336 Naive_RF Running Time: 0.0088 Tuned_RF Running Time: 26.192 Grid_RF Running Time: 176.1336 ++++++++++++++++++++ DataSet: antV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 0 , 21 (* | ---- ), 0.00, 0.00, 0.00, 0.21, 0.25 1 , Tuned_RF: Y-Def , 0 , 6 (* ------- | ), 0.00, 0.00, 0.00, 0.06, 0.12 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_CART: Y-Def , 12 , 0 ( *| ), 0.12, 0.12, 0.12, 0.12, 0.12 1 , Naive_RF: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 0 , 9 (* -|------- ), 0.00, 0.00, 0.00, 0.09, 0.14 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Tuned_RF: Y-Def , 5 , 10 ( * |-- ), 0.00, 0.00, 0.05, 0.10, 0.11 1 , Naive_RF: Y-Def , 9 , 0 ( *| ), 0.09, 0.09, 0.09, 0.09, 0.09 1 , Naive_CART: Y-Def , 18 , 0 ( | *), 0.18, 0.18, 0.18, 0.18, 0.18 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 0 , 17 (* | ------ ), 0.00, 0.00, 0.00, 0.17, 0.22 1 , Tuned_RF: Y-Def , 0 , 6 (* -------| ), 0.00, 0.00, 0.00, 0.06, 0.12 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07 1 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 0 , 20 (* | -- ), 0.00, 0.00, 0.00, 0.20, 0.22 1 , Tuned_RF: Y-Def , 0 , 6 (* -------| ), 0.00, 0.00, 0.00, 0.06, 0.12 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09 1 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 0 , 35 (* | -- ), 0.00, 0.00, 0.00, 0.35, 0.38 1 , Tuned_RF: Y-Def , 0 , 11 (* -------| ), 0.00, 0.00, 0.00, 0.11, 0.21 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_CART: Y-Def , 21 , 0 ( |* ), 0.21, 0.21, 0.21, 0.21, 0.21 1 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45 1 , Grid_CART: Y-Def , 62 , 0 ( *| ), 0.62, 0.62, 0.62, 0.62, 0.62 2 , Tuned_RF: Y-Def , 67 , 10 ( |- * --- ), 0.64, 0.65, 0.67, 0.75, 0.79 2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67 2 , Tuned_CART: Y-Def , 74 , 4 ( | - *-- ), 0.69, 0.71, 0.74, 0.75, 0.77 3 , Grid_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78 In terms of 5 : the times of better tuners are{'Tuned_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1} Naive_CART Running Time: 0.0012 Tuned_CART Running Time: 0.1466 Grid_CART Running Time: 0.6328 Naive_RF Running Time: 0.0088 Tuned_RF Running Time: 27.594 Grid_RF Running Time: 181.245 ++++++++++++++++++++ DataSet: antV1 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 10 (* --------|---- ), 0.00, 0.00, 0.00, 0.10, 0.26 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17 1 , Tuned_CART: Y-Def , 18 , 20 ( *|------------- ), 0.00, 0.00, 0.18, 0.20, 0.38 1 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 1 (* -------- | ), 0.00, 0.00, 0.00, 0.01, 0.03 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Tuned_CART: Y-Def , 4 , 5 ( | * -------- ), 0.00, 0.00, 0.04, 0.05, 0.07 2 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04 2 , Naive_CART: Y-Def , 5 , 0 ( | * ), 0.05, 0.05, 0.05, 0.05, 0.05 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 66 (* | - ), 0.00, 0.00, 0.00, 0.66, 0.70 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Tuned_CART: Y-Def , 56 , 57 ( | *- ), 0.00, 0.00, 0.57, 0.58, 0.63 1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59 1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 18 (* ----|-------- ), 0.00, 0.00, 0.00, 0.18, 0.38 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_RF: Y-Def , 26 , 0 ( |* ), 0.26, 0.26, 0.26, 0.26, 0.26 1 , Tuned_CART: Y-Def , 28 , 30 ( | * ---------- ), 0.00, 0.00, 0.28, 0.30, 0.47 1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 19 (* -----|------- ), 0.00, 0.00, 0.00, 0.19, 0.41 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.29, 0.29, 0.29, 0.29, 0.29 2 , Tuned_CART: Y-Def , 30 , 33 ( |* ----------- ), 0.00, 0.00, 0.30, 0.33, 0.53 2 , Naive_CART: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60 1 , Grid_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65 1 , Tuned_CART: Y-Def , 67 , 5 ( * --| ), 0.65, 0.65, 0.67, 0.70, 0.72 1 , Naive_RF: Y-Def , 71 , 0 ( *| ), 0.71, 0.71, 0.71, 0.71, 0.71 2 , Grid_RF: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81 2 , Tuned_RF: Y-Def , 82 , 1 ( | - *), 0.80, 0.81, 0.82, 0.82, 0.82 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1} Naive_CART Running Time: 0.0018 Tuned_CART Running Time: 0.1632 Grid_CART Running Time: 0.6758 Naive_RF Running Time: 0.0098 Tuned_RF Running Time: 24.7478 Grid_RF Running Time: 189.2922 ++++++++++++++++++++ DataSet: antV2 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 19 , 9 ( *--------|-------- ), 0.11, 0.11, 0.19, 0.20, 0.40 1 , Grid_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22 2 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33 2 , Tuned_RF: Y-Def , 34 , 12 ( -------|-- * ), 0.21, 0.33, 0.34, 0.45, 0.45 2 , Grid_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39 2 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 1 , 3 (* --------|----------- ), 0.01, 0.01, 0.01, 0.04, 0.12 1 , Grid_RF: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01 1 , Tuned_RF: Y-Def , 3 , 4 ( * | ), 0.02, 0.02, 0.03, 0.06, 0.06 2 , Grid_CART: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 2 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50 1 , Naive_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60 1 , Tuned_CART: Y-Def , 63 , 6 (--------- *|------------- ), 0.48, 0.58, 0.63, 0.63, 0.78 1 , Grid_CART: Y-Def , 65 , 0 ( |* ), 0.65, 0.65, 0.65, 0.65, 0.65 2 , Tuned_RF: Y-Def , 72 , 8 ( | * --- ), 0.66, 0.66, 0.72, 0.74, 0.77 3 , Grid_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 30 , 11 ( *-----|----- ), 0.19, 0.19, 0.30, 0.30, 0.44 1 , Grid_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34 2 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43 2 , Tuned_RF: Y-Def , 46 , 8 ( ----|-------* ), 0.32, 0.46, 0.46, 0.54, 0.54 2 , Naive_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48 2 , Grid_CART: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 32 , 13 ( *------|--------- ), 0.20, 0.20, 0.32, 0.33, 0.55 1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36 2 , Naive_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49 2 , Tuned_RF: Y-Def , 50 , 12 ( -----|-----* ), 0.34, 0.49, 0.50, 0.61, 0.61 2 , Grid_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55 2 , Naive_CART: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66 1 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76 1 , Tuned_CART: Y-Def , 77 , 2 ( | --* -- ), 0.76, 0.77, 0.77, 0.79, 0.80 2 , Grid_CART: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80 3 , Tuned_RF: Y-Def , 82 , 0 ( | *), 0.82, 0.82, 0.82, 0.82, 0.82 3 , Grid_RF: Y-Def , 82 , 0 ( | *), 0.82, 0.82, 0.82, 0.82, 0.82 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1} Naive_CART Running Time: 0.0028 Tuned_CART Running Time: 0.2608 Grid_CART Running Time: 0.7648 Naive_RF Running Time: 0.0116 Tuned_RF Running Time: 28.6218 Grid_RF Running Time: 205.6206 ++++++++++++++++++++ DataSet: camelV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 3 , 4 ( *-- | ), 0.00, 0.00, 0.03, 0.04, 0.08 2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17 3 , Grid_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33 4 , Tuned_CART: Y-Def , 41 , 5 ( | * ), 0.41, 0.41, 0.41, 0.46, 0.46 4 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46 4 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02 3 , Naive_RF: Y-Def , 13 , 0 ( |* ), 0.13, 0.13, 0.13, 0.13, 0.13 3 , Grid_CART: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14 4 , Tuned_CART: Y-Def , 19 , 0 ( | -* ), 0.18, 0.19, 0.19, 0.19, 0.19 4 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29 1 , Tuned_CART: Y-Def , 30 , 1 ( * | ), 0.29, 0.30, 0.30, 0.31, 0.32 1 , Grid_CART: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32 1 , Naive_RF: Y-Def , 40 , 0 ( *| ), 0.40, 0.40, 0.40, 0.40, 0.40 1 , Grid_RF: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57 1 , Tuned_RF: Y-Def , 70 , 72 ( | *--- ), 0.00, 0.00, 0.70, 0.72, 0.83 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 6 , 9 ( * ---- | ), 0.00, 0.00, 0.06, 0.09, 0.15 2 , Grid_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27 3 , Grid_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33 4 , Tuned_CART: Y-Def , 35 , 3 ( | *- ), 0.34, 0.34, 0.35, 0.37, 0.38 4 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36 4 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 6 , 9 ( * --- | ), 0.00, 0.00, 0.06, 0.09, 0.16 2 , Grid_RF: Y-Def , 30 , 0 ( *| ), 0.30, 0.30, 0.30, 0.30, 0.30 3 , Grid_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48 4 , Tuned_CART: Y-Def , 54 , 3 ( | * ), 0.54, 0.54, 0.54, 0.58, 0.58 4 , Naive_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59 4 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61 1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62 2 , Tuned_CART: Y-Def , 66 , 2 ( ---- * | ), 0.63, 0.65, 0.66, 0.67, 0.67 3 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74 3 , Tuned_RF: Y-Def , 75 , 1 ( | --* ), 0.74, 0.75, 0.75, 0.76, 0.76 4 , Grid_RF: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 3, 'Grid_RF: Y-Def': 2} Naive_CART Running Time: 0.0038 Tuned_CART Running Time: 0.305 Grid_CART Running Time: 0.9108 Naive_RF Running Time: 0.0136 Tuned_RF Running Time: 34.436 Grid_RF Running Time: 232.5146 ++++++++++++++++++++ DataSet: camelV1 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 18 , 0 (* | ), 0.18, 0.18, 0.18, 0.18, 0.18 1 , Tuned_RF: Y-Def , 22 , 1 ( -- * | ), 0.20, 0.21, 0.22, 0.22, 0.23 1 , Grid_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22 2 , Naive_RF: Y-Def , 27 , 0 ( * ), 0.27, 0.27, 0.27, 0.27, 0.27 2 , Tuned_CART: Y-Def , 32 , 9 ( --- | *--- ), 0.21, 0.23, 0.32, 0.32, 0.34 2 , Naive_CART: Y-Def , 35 , 0 ( | *), 0.35, 0.35, 0.35, 0.35, 0.35 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 5 , 1 (* | ), 0.05, 0.05, 0.05, 0.06, 0.06 1 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 2 , Grid_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07 2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08 3 , Tuned_CART: Y-Def , 11 , 3 ( ------| * --- ), 0.08, 0.10, 0.11, 0.13, 0.14 3 , Naive_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 37 , 2 (- *---------| ), 0.34, 0.35, 0.37, 0.37, 0.42 1 , Grid_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37 1 , Naive_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41 2 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43 2 , Grid_RF: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44 3 , Tuned_RF: Y-Def , 47 , 1 ( | --------* -- ), 0.43, 0.47, 0.47, 0.48, 0.49 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24 2 , Tuned_RF: Y-Def , 30 , 3 ( -- * | ), 0.28, 0.29, 0.30, 0.31, 0.31 2 , Grid_RF: Y-Def , 30 , 0 ( * | ), 0.30, 0.30, 0.30, 0.30, 0.30 2 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33 2 , Tuned_CART: Y-Def , 34 , 7 ( -- | * ---- ), 0.27, 0.28, 0.34, 0.35, 0.37 2 , Naive_CART: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 30 , 0 (* | ), 0.30, 0.30, 0.30, 0.30, 0.30 1 , Tuned_RF: Y-Def , 36 , 2 ( - *- | ), 0.33, 0.34, 0.36, 0.36, 0.37 1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36 2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42 2 , Tuned_CART: Y-Def , 47 , 11 ( --- | * ), 0.35, 0.37, 0.47, 0.48, 0.48 2 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63 1 , Grid_CART: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63 2 , Tuned_CART: Y-Def , 67 , 1 ( *|------ ), 0.66, 0.66, 0.67, 0.67, 0.69 2 , Naive_RF: Y-Def , 67 , 0 ( *| ), 0.67, 0.67, 0.67, 0.67, 0.67 3 , Tuned_RF: Y-Def , 69 , 0 ( | *--- ), 0.69, 0.69, 0.69, 0.69, 0.70 4 , Grid_RF: Y-Def , 71 , 0 ( | *), 0.71, 0.71, 0.71, 0.71, 0.71 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 3} Naive_CART Running Time: 0.0012 Tuned_CART Running Time: 0.1204 Grid_CART Running Time: 0.6322 Naive_RF Running Time: 0.009 Tuned_RF Running Time: 25.6758 Grid_RF Running Time: 176.6064 ++++++++++++++++++++ DataSet: ivyV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Naive_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12 2 , Tuned_CART: Y-Def , 20 , 30 ( *| - ), 0.00, 0.00, 0.20, 0.30, 0.32 2 , Grid_CART: Y-Def , 22 , 0 ( * ), 0.22, 0.22, 0.22, 0.22, 0.22 2 , Naive_CART: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Tuned_CART: Y-Def , 5 , 7 ( * | ), 0.00, 0.00, 0.05, 0.07, 0.07 2 , Grid_CART: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08 2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08 2 , Naive_CART: Y-Def , 19 , 0 ( | *), 0.19, 0.19, 0.19, 0.19, 0.19 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16 2 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21 2 , Grid_CART: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26 2 , Tuned_CART: Y-Def , 32 , 35 ( | * - ), 0.00, 0.00, 0.32, 0.35, 0.37 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Naive_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14 2 , Tuned_CART: Y-Def , 24 , 32 ( | * - ), 0.00, 0.00, 0.24, 0.32, 0.34 2 , Grid_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24 2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22 2 , Tuned_CART: Y-Def , 33 , 45 ( | * -- ), 0.00, 0.00, 0.33, 0.45, 0.48 2 , Grid_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36 2 , Naive_CART: Y-Def , 55 , 0 ( | *), 0.55, 0.55, 0.55, 0.55, 0.55 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61 1 , Naive_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70 1 , Tuned_CART: Y-Def , 74 , 2 ( | *--- ), 0.73, 0.73, 0.74, 0.75, 0.77 1 , Grid_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75 2 , Grid_RF: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81 2 , Tuned_RF: Y-Def , 82 , 1 ( | *), 0.81, 0.81, 0.82, 0.82, 0.82 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 3} Naive_CART Running Time: 0.0016 Tuned_CART Running Time: 0.152 Grid_CART Running Time: 0.6606 Naive_RF Running Time: 0.0094 Tuned_RF Running Time: 26.439 Grid_RF Running Time: 187.8622 ++++++++++++++++++++ DataSet: jeditV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37 2 , Grid_CART: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46 2 , Naive_RF: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46 2 , Tuned_CART: Y-Def , 48 , 6 (------- *-|------------- ), 0.36, 0.43, 0.48, 0.49, 0.63 2 , Tuned_RF: Y-Def , 50 , 1 ( - * ), 0.48, 0.49, 0.50, 0.50, 0.51 2 , Naive_CART: Y-Def , 51 , 0 ( |* ), 0.51, 0.51, 0.51, 0.51, 0.51 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03 2 , Tuned_RF: Y-Def , 7 , 1 ( --* ---- | ), 0.06, 0.07, 0.07, 0.08, 0.10 2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08 2 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09 3 , Tuned_CART: Y-Def , 12 , 1 ( ------|* ----------- ), 0.08, 0.12, 0.12, 0.13, 0.19 3 , Grid_CART: Y-Def , 12 , 0 ( |* ), 0.12, 0.12, 0.12, 0.12, 0.12 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55 1 , Tuned_CART: Y-Def , 56 , 5 (---- * -----| ), 0.47, 0.52, 0.56, 0.58, 0.64 2 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66 2 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66 2 , Tuned_RF: Y-Def , 69 , 3 ( -|-- *---- ), 0.62, 0.66, 0.69, 0.69, 0.74 3 , Grid_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 50 , 0 ( *| ), 0.50, 0.50, 0.50, 0.50, 0.50 1 , Grid_RF: Y-Def , 51 , 0 ( * ), 0.51, 0.51, 0.51, 0.51, 0.51 1 , Tuned_CART: Y-Def , 52 , 2 (---------------| *------- ), 0.41, 0.51, 0.52, 0.53, 0.57 2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54 2 , Tuned_RF: Y-Def , 56 , 4 ( | * - ), 0.55, 0.55, 0.57, 0.59, 0.60 2 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54 2 , Grid_CART: Y-Def , 60 , 0 ( *| ), 0.60, 0.60, 0.60, 0.60, 0.60 2 , Tuned_CART: Y-Def , 62 , 6 (----------- | *----------- ), 0.51, 0.58, 0.62, 0.63, 0.70 2 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62 3 , Tuned_RF: Y-Def , 64 , 1 ( | --* - ), 0.63, 0.64, 0.64, 0.65, 0.66 3 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71 1 , Tuned_CART: Y-Def , 76 , 3 ( --- * | ), 0.74, 0.75, 0.76, 0.78, 0.78 1 , Grid_CART: Y-Def , 76 , 0 ( * | ), 0.76, 0.76, 0.76, 0.76, 0.76 2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82 2 , Tuned_RF: Y-Def , 83 , 1 ( | * ), 0.83, 0.83, 0.83, 0.84, 0.84 2 , Grid_RF: Y-Def , 83 , 0 ( | * ), 0.83, 0.83, 0.83, 0.83, 0.83 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 3} Naive_CART Running Time: 0.0018 Tuned_CART Running Time: 0.177 Grid_CART Running Time: 0.6688 Naive_RF Running Time: 0.0094 Tuned_RF Running Time: 26.1002 Grid_RF Running Time: 189.299 ++++++++++++++++++++ DataSet: jeditV1 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54 1 , Grid_RF: Y-Def , 57 , 0 ( * ), 0.58, 0.58, 0.58, 0.58, 0.58 1 , Grid_CART: Y-Def , 57 , 0 ( * ), 0.58, 0.58, 0.58, 0.58, 0.58 1 , Tuned_RF: Y-Def , 62 , 2 ( |-- * ), 0.58, 0.60, 0.62, 0.62, 0.62 1 , Naive_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64 1 , Tuned_CART: Y-Def , 64 , 2 (---------------|----- *---- ), 0.47, 0.62, 0.64, 0.64, 0.68 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Grid_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Tuned_RF: Y-Def , 11 , 0 (------*-- | ), 0.09, 0.11, 0.11, 0.11, 0.12 2 , Naive_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13 2 , Tuned_CART: Y-Def , 15 , 3 (--------- | *--------- ), 0.09, 0.12, 0.15, 0.15, 0.18 2 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35 1 , Tuned_CART: Y-Def , 38 , 4 ( -----* | ----- ), 0.36, 0.38, 0.38, 0.42, 0.44 1 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38 2 , Tuned_RF: Y-Def , 44 , 1 ( | -----* ----- ), 0.42, 0.44, 0.44, 0.45, 0.47 2 , Grid_RF: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44 2 , Grid_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_RF: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44 1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45 1 , Tuned_CART: Y-Def , 48 , 1 ( ---- *|------ ), 0.46, 0.47, 0.48, 0.48, 0.50 2 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50 3 , Grid_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51 3 , Tuned_RF: Y-Def , 52 , 1 ( | -------- *), 0.49, 0.51, 0.52, 0.52, 0.52 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66 1 , Grid_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70 1 , Grid_CART: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70 1 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72 1 , Tuned_CART: Y-Def , 73 , 1 (---------------|-------- *- ), 0.62, 0.72, 0.73, 0.73, 0.74 1 , Tuned_RF: Y-Def , 73 , 2 ( | --- * ), 0.70, 0.71, 0.73, 0.73, 0.73 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73 1 , Grid_CART: Y-Def , 77 , 0 ( * | ), 0.77, 0.77, 0.77, 0.77, 0.77 1 , Tuned_CART: Y-Def , 78 , 5 ( * | ), 0.77, 0.77, 0.78, 0.82, 0.82 2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82 2 , Tuned_RF: Y-Def , 85 , 1 ( | * ), 0.85, 0.85, 0.85, 0.86, 0.86 2 , Grid_RF: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 4} Naive_CART Running Time: 0.0018 Tuned_CART Running Time: 0.1638 Grid_CART Running Time: 0.6976 Naive_RF Running Time: 0.0096 Tuned_RF Running Time: 24.586 Grid_RF Running Time: 191.8906 ++++++++++++++++++++ DataSet: jeditV2 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45 1 , Tuned_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45 1 , Tuned_RF: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45 1 , Grid_RF: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45 2 , Grid_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54 2 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 7 , 1 ( ----* | ), 0.05, 0.07, 0.07, 0.08, 0.08 1 , Grid_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08 1 , Tuned_CART: Y-Def , 9 , 2 (------ * | ), 0.04, 0.07, 0.09, 0.09, 0.09 1 , Grid_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09 1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05 1 , Tuned_CART: Y-Def , 10 , 2 ( * | ------------ ), 0.10, 0.10, 0.10, 0.12, 0.17 1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Grid_RF: Y-Def , 11 , 0 ( *| ), 0.11, 0.11, 0.11, 0.11, 0.11 1 , Grid_CART: Y-Def , 11 , 0 ( *| ), 0.11, 0.11, 0.11, 0.11, 0.11 1 , Tuned_RF: Y-Def , 12 , 2 ( | *--------- ), 0.10, 0.10, 0.12, 0.12, 0.16 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09 1 , Tuned_CART: Y-Def , 16 , 3 ( * | ----------- ), 0.16, 0.16, 0.16, 0.19, 0.25 1 , Grid_RF: Y-Def , 17 , 0 ( *| ), 0.17, 0.17, 0.17, 0.17, 0.17 1 , Naive_RF: Y-Def , 17 , 0 ( *| ), 0.17, 0.17, 0.17, 0.17, 0.17 1 , Tuned_RF: Y-Def , 19 , 2 ( | *------- ), 0.17, 0.17, 0.19, 0.19, 0.23 1 , Grid_CART: Y-Def , 19 , 0 ( | * ), 0.19, 0.19, 0.19, 0.19, 0.19 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58 1 , Tuned_CART: Y-Def , 60 , 1 ( * | ), 0.60, 0.60, 0.60, 0.61, 0.61 1 , Tuned_RF: Y-Def , 60 , 1 ( * | ), 0.60, 0.60, 0.60, 0.61, 0.61 1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60 2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67 2 , Grid_CART: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63 1 , Tuned_RF: Y-Def , 64 , 1 ( *--- | ), 0.63, 0.63, 0.64, 0.64, 0.66 1 , Tuned_CART: Y-Def , 65 , 0 (---*- | ), 0.63, 0.65, 0.65, 0.65, 0.66 1 , Grid_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65 2 , Grid_RF: Y-Def , 71 , 0 ( * ), 0.71, 0.71, 0.71, 0.71, 0.71 2 , Naive_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 5} Naive_CART Running Time: 0.0008 Tuned_CART Running Time: 0.0956 Grid_CART Running Time: 0.5948 Naive_RF Running Time: 0.008 Tuned_RF Running Time: 27.0348 Grid_RF Running Time: 171.8958 ++++++++++++++++++++ DataSet: log4jV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 15 , 0 (---------*-----|-- ), 0.07, 0.15, 0.15, 0.15, 0.23 2 , Tuned_CART: Y-Def , 23 , 0 ( --|--*---------- ), 0.19, 0.23, 0.23, 0.23, 0.33 2 , Grid_RF: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24 2 , Naive_RF: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24 2 , Grid_CART: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26 2 , Naive_CART: Y-Def , 33 , 0 ( | *), 0.33, 0.33, 0.33, 0.33, 0.33 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.06 1 , Tuned_CART: Y-Def , 6 , 0 (-----*---------|------------- ), 0.00, 0.06, 0.06, 0.06, 0.31 1 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 2 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12 2 , Naive_RF: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18 2 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_RF: Y-Def , 93 , 0 ( * | ), 0.93, 0.93, 0.93, 0.93, 0.93 1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94 1 , Grid_CART: Y-Def , 96 , 0 ( *| ), 0.96, 0.96, 0.96, 0.96, 0.96 1 , Tuned_CART: Y-Def , 97 , 0 (---------------|--*---------- ), 0.92, 0.97, 0.97, 0.97, 1.00 1 , Grid_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97 2 , Tuned_RF: Y-Def , 100 , 0 ( | -----------*), 0.97, 1.00, 1.00, 1.00, 1.00 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 27 , 1 (---------- *---|---- ), 0.13, 0.26, 0.27, 0.27, 0.38 2 , Tuned_CART: Y-Def , 38 , 0 ( |----*-------- ), 0.32, 0.38, 0.38, 0.38, 0.49 2 , Naive_RF: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38 2 , Grid_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39 2 , Grid_CART: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41 2 , Naive_CART: Y-Def , 49 , 0 ( | *), 0.49, 0.49, 0.49, 0.49, 0.49 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 27 , 1 (----------- *--|----- ), 0.13, 0.26, 0.27, 0.27, 0.37 2 , Tuned_CART: Y-Def , 37 , 0 ( | ----*------- ), 0.32, 0.37, 0.37, 0.37, 0.45 2 , Naive_RF: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37 2 , Grid_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39 2 , Grid_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40 2 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 51 , 10 (- * | --- ), 0.48, 0.49, 0.51, 0.59, 0.61 1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53 1 , Grid_CART: Y-Def , 56 , 0 ( *| ), 0.56, 0.56, 0.56, 0.56, 0.56 1 , Tuned_RF: Y-Def , 57 , 0 ( |-*- ), 0.57, 0.58, 0.58, 0.58, 0.59 1 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60 2 , Grid_RF: Y-Def , 65 , 0 ( | *), 0.65, 0.65, 0.65, 0.65, 0.65 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6} Naive_CART Running Time: 0.0014 Tuned_CART Running Time: 0.1362 Grid_CART Running Time: 0.6442 Naive_RF Running Time: 0.009 Tuned_RF Running Time: 26.173 Grid_RF Running Time: 181.4096 ++++++++++++++++++++ DataSet: luceneV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55 1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57 1 , Naive_RF: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62 2 , Tuned_CART: Y-Def , 67 , 3 (---------------| * --- ), 0.53, 0.66, 0.67, 0.69, 0.71 2 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69 3 , Tuned_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.76 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34 1 , Naive_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35 2 , Grid_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36 2 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37 3 , Tuned_RF: Y-Def , 43 , 2 ( | *- ), 0.42, 0.42, 0.43, 0.44, 0.45 3 , Tuned_CART: Y-Def , 48 , 13 (-------------- | * - ), 0.26, 0.40, 0.48, 0.53, 0.54 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 67 , 4 (-- * -|------------- ), 0.65, 0.66, 0.67, 0.70, 0.75 1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69 1 , Grid_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69 2 , Tuned_RF: Y-Def , 72 , 1 ( | * ), 0.71, 0.71, 0.72, 0.72, 0.72 2 , Naive_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72 3 , Grid_RF: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61 1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62 2 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66 2 , Tuned_CART: Y-Def , 67 , 1 ( -----------* | ), 0.62, 0.67, 0.67, 0.68, 0.68 3 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72 4 , Tuned_RF: Y-Def , 73 , 1 ( | * ), 0.73, 0.73, 0.73, 0.74, 0.74 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 57 , 5 (-- * -|- ), 0.55, 0.56, 0.58, 0.61, 0.62 1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59 1 , Grid_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59 2 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63 2 , Tuned_RF: Y-Def , 64 , 1 ( | ---* ), 0.63, 0.64, 0.64, 0.65, 0.65 3 , Grid_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59 1 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63 1 , Tuned_CART: Y-Def , 64 , 1 ( -----* --|-- ), 0.62, 0.64, 0.64, 0.65, 0.67 2 , Grid_CART: Y-Def , 66 , 0 ( |* ), 0.66, 0.66, 0.66, 0.66, 0.66 3 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69 4 , Tuned_RF: Y-Def , 72 , 0 ( | *), 0.72, 0.72, 0.72, 0.72, 0.72 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 4, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6} Naive_CART Running Time: 0.0016 Tuned_CART Running Time: 0.1384 Grid_CART Running Time: 0.6522 Naive_RF Running Time: 0.0092 Tuned_RF Running Time: 26.4286 Grid_RF Running Time: 184.5288 ++++++++++++++++++++ DataSet: poiV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Tuned_RF: Y-Def , 2 , 1 ( --* -- | ), 0.01, 0.02, 0.02, 0.03, 0.04 2 , Grid_RF: Y-Def , 3 , 0 ( * | ), 0.03, 0.03, 0.03, 0.03, 0.03 3 , Tuned_CART: Y-Def , 7 , 2 ( ---------- | * --- ), 0.02, 0.06, 0.07, 0.08, 0.09 3 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09 3 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 2 (* | ), 0.00, 0.00, 0.00, 0.02, 0.02 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02 2 , Tuned_CART: Y-Def , 6 , 4 ( ----- *| ---------- ), 0.02, 0.04, 0.06, 0.08, 0.12 2 , Naive_RF: Y-Def , 6 , 0 ( *| ), 0.06, 0.06, 0.06, 0.06, 0.06 2 , Naive_CART: Y-Def , 11 , 0 ( | * ), 0.11, 0.11, 0.11, 0.11, 0.11 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Naive_CART: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.65 2 , Tuned_CART: Y-Def , 66 , 20 ( -------|- * ), 0.29, 0.58, 0.66, 0.77, 0.78 2 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71 2 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72 3 , Tuned_RF: Y-Def , 85 , 24 ( | * ), 0.75, 0.76, 0.85, 1.00, 1.00 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Tuned_RF: Y-Def , 4 , 2 ( -* -- | ), 0.03, 0.04, 0.04, 0.06, 0.07 2 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 3 , Tuned_CART: Y-Def , 13 , 4 ( -----------| * - ), 0.03, 0.11, 0.13, 0.15, 0.16 3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16 3 , Naive_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Tuned_RF: Y-Def , 4 , 2 ( -* - | ), 0.03, 0.04, 0.04, 0.06, 0.07 2 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 3 , Tuned_CART: Y-Def , 13 , 4 ( -----------| * --- ), 0.03, 0.11, 0.13, 0.15, 0.17 3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16 3 , Naive_CART: Y-Def , 21 , 0 ( | *), 0.21, 0.21, 0.21, 0.21, 0.21 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36 2 , Tuned_CART: Y-Def , 37 , 1 (- *-----------| ), 0.35, 0.36, 0.37, 0.37, 0.43 2 , Tuned_RF: Y-Def , 37 , 1 ( --* ---- | ), 0.36, 0.37, 0.37, 0.38, 0.40 3 , Grid_CART: Y-Def , 42 , 0 ( * | ), 0.42, 0.42, 0.42, 0.42, 0.42 3 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48 3 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6} Naive_CART Running Time: 0.0026 Tuned_CART Running Time: 0.155 Grid_CART Running Time: 0.7054 Naive_RF Running Time: 0.0104 Tuned_RF Running Time: 24.1832 Grid_RF Running Time: 193.1604 ++++++++++++++++++++ DataSet: poiV1 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 2 , Tuned_CART: Y-Def , 16 , 26 ( | * ), 0.00, 0.00, 0.16, 0.26, 0.26 2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16 2 , Naive_CART: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02 1 , Tuned_CART: Y-Def , 3 , 7 ( * | ), 0.00, 0.00, 0.03, 0.07, 0.07 1 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75 1 , Tuned_CART: Y-Def , 86 , 86 ( | * ), 0.00, 0.00, 0.86, 0.86, 0.90 1 , Naive_RF: Y-Def , 92 , 0 ( | *), 0.92, 0.92, 0.92, 0.92, 0.92 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Tuned_CART: Y-Def , 28 , 40 ( | * ), 0.00, 0.00, 0.28, 0.40, 0.40 1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28 1 , Naive_CART: Y-Def , 39 , 0 ( | *), 0.39, 0.39, 0.39, 0.39, 0.39 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Tuned_CART: Y-Def , 28 , 41 ( | * ), 0.00, 0.00, 0.28, 0.41, 0.41 1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28 1 , Naive_CART: Y-Def , 40 , 0 ( | *), 0.40, 0.40, 0.40, 0.40, 0.40 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58 1 , Tuned_CART: Y-Def , 59 , 0 (---* | ), 0.56, 0.59, 0.59, 0.59, 0.59 1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63 2 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77 2 , Grid_RF: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78 3 , Tuned_RF: Y-Def , 80 , 1 ( | --*- ), 0.78, 0.80, 0.80, 0.81, 0.82 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 6} Naive_CART Running Time: 0.0012 Tuned_CART Running Time: 0.1398 Grid_CART Running Time: 0.6402 Naive_RF Running Time: 0.0088 Tuned_RF Running Time: 24.3292 Grid_RF Running Time: 177.67 ++++++++++++++++++++ DataSet: synapseV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16 1 , Tuned_RF: Y-Def , 17 , 14 (------ * | ), 0.00, 0.09, 0.17, 0.23, 0.23 2 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27 2 , Naive_CART: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31 2 , Tuned_CART: Y-Def , 38 , 7 (---------------|------- *- ), 0.00, 0.32, 0.38, 0.39, 0.41 2 , Grid_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02 1 , Tuned_RF: Y-Def , 3 , 3 (- * | ), 0.00, 0.01, 0.03, 0.04, 0.04 2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06 2 , Tuned_CART: Y-Def , 7 , 5 (-----------* | ---------- ), 0.00, 0.07, 0.07, 0.12, 0.18 2 , Grid_CART: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08 2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50 1 , Tuned_CART: Y-Def , 62 , 16 (---------------|--- * - ), 0.00, 0.52, 0.62, 0.68, 0.71 1 , Naive_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68 1 , Grid_CART: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70 1 , Tuned_RF: Y-Def , 71 , 3 (---------------|----------*-- ), 0.00, 0.71, 0.71, 0.74, 0.80 1 , Grid_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 26 , 0 ( * ), 0.26, 0.26, 0.26, 0.26, 0.26 1 , Tuned_RF: Y-Def , 28 , 19 (--------- |* ), 0.00, 0.16, 0.28, 0.35, 0.35 2 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38 2 , Naive_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39 2 , Tuned_CART: Y-Def , 45 , 6 (---------------|----------* ), 0.00, 0.44, 0.45, 0.50, 0.50 2 , Grid_CART: Y-Def , 49 , 0 ( | *), 0.49, 0.49, 0.49, 0.49, 0.49 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 27 , 0 ( *| ), 0.27, 0.27, 0.27, 0.27, 0.27 1 , Tuned_RF: Y-Def , 28 , 20 (--------- * ), 0.00, 0.17, 0.29, 0.37, 0.37 2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42 2 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45 2 , Tuned_CART: Y-Def , 53 , 6 (---------------|--------- * ), 0.00, 0.48, 0.53, 0.54, 0.56 2 , Grid_CART: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58 1 , Grid_CART: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68 1 , Tuned_CART: Y-Def , 69 , 6 ( -- | * -- ), 0.63, 0.64, 0.69, 0.70, 0.71 1 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69 2 , Tuned_RF: Y-Def , 72 , 1 ( | * - ), 0.72, 0.72, 0.72, 0.73, 0.74 2 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 7} Naive_CART Running Time: 0.0012 Tuned_CART Running Time: 0.1226 Grid_CART Running Time: 0.628 Naive_RF Running Time: 0.0086 Tuned_RF Running Time: 26.8088 Grid_RF Running Time: 179.0512 ++++++++++++++++++++ DataSet: velocityV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 46 , 0 (----------*----|------------- ), 0.17, 0.46, 0.46, 0.46, 0.98 2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82 2 , Tuned_RF: Y-Def , 97 , 6 ( | ----- * ), 0.78, 0.92, 0.97, 0.98, 1.00 2 , Naive_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98 2 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00 2 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 41 , 3 (---*-----------|------------ ), 0.33, 0.40, 0.41, 0.43, 0.97 2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82 2 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94 2 , Tuned_RF: Y-Def , 94 , 16 ( | --- * ), 0.74, 0.82, 0.94, 0.98, 0.99 3 , Grid_RF: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98 4 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33 1 , Tuned_RF: Y-Def , 34 , 1 ( | * -- ), 0.34, 0.34, 0.34, 0.35, 0.36 1 , Grid_RF: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34 1 , Grid_CART: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34 1 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35 1 , Tuned_CART: Y-Def , 35 , 2 (---------------|-------- * - ), 0.21, 0.34, 0.35, 0.36, 0.37 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 40 , 1 (---------------|---*-------- ), 0.19, 0.40, 0.40, 0.41, 0.50 2 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47 2 , Tuned_RF: Y-Def , 50 , 1 ( | --* ), 0.48, 0.50, 0.50, 0.51, 0.52 2 , Grid_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50 3 , Naive_CART: Y-Def , 51 , 0 ( | *), 0.51, 0.51, 0.51, 0.51, 0.51 3 , Grid_RF: Y-Def , 51 , 0 ( | *), 0.51, 0.51, 0.51, 0.51, 0.51 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02 1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Tuned_RF: Y-Def , 10 , 25 (- * |----- ), 0.01, 0.03, 0.10, 0.29, 0.38 1 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.28, 0.28, 0.28, 0.28, 0.28 1 , Tuned_CART: Y-Def , 50 , 23 ( -------------| * ), 0.05, 0.28, 0.50, 0.51, 0.52 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46 1 , Tuned_CART: Y-Def , 50 , 9 (------ * | -- ), 0.41, 0.46, 0.50, 0.55, 0.57 2 , Naive_CART: Y-Def , 52 , 0 ( *| ), 0.52, 0.52, 0.52, 0.52, 0.52 2 , Tuned_RF: Y-Def , 53 , 7 ( --- |* ------ ), 0.48, 0.50, 0.53, 0.58, 0.63 2 , Naive_RF: Y-Def , 53 , 0 ( |* ), 0.53, 0.53, 0.53, 0.53, 0.53 2 , Grid_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 8} Naive_CART Running Time: 0.0014 Tuned_CART Running Time: 0.146 Grid_CART Running Time: 0.6552 Naive_RF Running Time: 0.0094 Tuned_RF Running Time: 25.6514 Grid_RF Running Time: 185.877 ++++++++++++++++++++ DataSet: xercesV0 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13 2 , Grid_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14 2 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15 3 , Naive_CART: Y-Def , 23 , 0 ( * ), 0.23, 0.23, 0.23, 0.23, 0.23 3 , Tuned_CART: Y-Def , 26 , 15 (---------------| * ), 0.05, 0.24, 0.26, 0.39, 0.39 3 , Tuned_RF: Y-Def , 26 , 2 ( -| * ), 0.21, 0.24, 0.26, 0.26, 0.27 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08 1 , Tuned_RF: Y-Def , 11 , 1 ( ---* | ), 0.10, 0.11, 0.11, 0.12, 0.12 1 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12 2 , Naive_RF: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14 2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15 2 , Tuned_CART: Y-Def , 15 , 4 ( ----------|- * ), 0.10, 0.14, 0.15, 0.18, 0.18 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15 1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16 2 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21 2 , Grid_RF: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22 2 , Tuned_CART: Y-Def , 23 , 4 (---------------|------* ), 0.09, 0.23, 0.23, 0.27, 0.27 3 , Tuned_RF: Y-Def , 27 , 2 ( | * ), 0.26, 0.26, 0.27, 0.28, 0.28 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14 2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16 2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17 3 , Naive_CART: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22 3 , Tuned_CART: Y-Def , 24 , 8 (---------------|----* ), 0.07, 0.24, 0.24, 0.32, 0.32 3 , Tuned_RF: Y-Def , 26 , 2 ( | - *-- ), 0.24, 0.25, 0.26, 0.27, 0.28 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_CART: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22 2 , Grid_RF: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25 2 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26 3 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36 3 , Tuned_CART: Y-Def , 39 , 14 (---------------|--- * ), 0.10, 0.38, 0.39, 0.52, 0.52 3 , Tuned_RF: Y-Def , 40 , 2 ( | -- * ), 0.34, 0.38, 0.40, 0.40, 0.41 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51 1 , Grid_CART: Y-Def , 56 , 0 ( *| ), 0.57, 0.57, 0.57, 0.57, 0.57 1 , Tuned_CART: Y-Def , 57 , 4 ( ---|-* ), 0.56, 0.58, 0.58, 0.61, 0.61 1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59 2 , Grid_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60 3 , Tuned_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 11, 'Grid_RF: Y-Def': 8} Naive_CART Running Time: 0.002 Tuned_CART Running Time: 0.1908 Grid_CART Running Time: 0.7034 Naive_RF Running Time: 0.01 Tuned_RF Running Time: 26.5334 Grid_RF Running Time: 196.3468 ++++++++++++++++++++ DataSet: xercesV1 ++++++++++++++++++++ ********** pd ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05 2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09 2 , Tuned_RF: Y-Def , 10 , 1 ( * | ), 0.10, 0.10, 0.10, 0.11, 0.11 2 , Grid_CART: Y-Def , 11 , 0 ( |* ), 0.11, 0.11, 0.11, 0.11, 0.11 3 , Naive_CART: Y-Def , 13 , 0 ( | * ), 0.13, 0.13, 0.13, 0.13, 0.13 3 , Tuned_CART: Y-Def , 16 , 0 ( | --------*), 0.13, 0.16, 0.16, 0.16, 0.16 ********** pf ********** rank , name , med , iqr ---------------------------------------------------- 1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00 1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01 1 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04 1 , Naive_CART: Y-Def , 5 , 0 ( | *), 0.05, 0.05, 0.05, 0.05, 0.05 ********** prec ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85 1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88 1 , Grid_RF: Y-Def , 92 , 0 ( * | ), 0.92, 0.92, 0.92, 0.92, 0.92 2 , Tuned_RF: Y-Def , 98 , 1 ( | *--- ), 0.97, 0.97, 0.98, 0.98, 1.00 2 , Grid_CART: Y-Def , 98 , 0 ( | * ), 0.98, 0.98, 0.98, 0.98, 0.98 2 , Tuned_CART: Y-Def , 100 , 0 ( | ----*), 0.98, 1.00, 1.00, 1.00, 1.00 ********** f ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16 2 , Tuned_RF: Y-Def , 19 , 2 ( *|-- ), 0.18, 0.18, 0.19, 0.20, 0.21 2 , Grid_CART: Y-Def , 20 , 0 ( |* ), 0.20, 0.20, 0.20, 0.20, 0.20 3 , Naive_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24 3 , Tuned_CART: Y-Def , 28 , 1 ( | ----- *), 0.24, 0.27, 0.28, 0.28, 0.28 ********** g ********** rank , name , med , iqr ---------------------------------------------------- 1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10 1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16 2 , Tuned_RF: Y-Def , 19 , 2 ( *|-- ), 0.18, 0.18, 0.19, 0.20, 0.21 2 , Grid_CART: Y-Def , 20 , 0 ( |* ), 0.20, 0.20, 0.20, 0.20, 0.20 3 , Naive_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24 3 , Tuned_CART: Y-Def , 28 , 1 ( | ----- *), 0.24, 0.27, 0.28, 0.28, 0.28 ********** auc ********** rank , name , med , iqr ---------------------------------------------------- 1 , Naive_CART: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44 1 , Grid_RF: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44 2 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45 2 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50 3 , Tuned_CART: Y-Def , 56 , 4 ( ----* | ----- ), 0.52, 0.56, 0.56, 0.60, 0.64 4 , Tuned_RF: Y-Def , 66 , 3 ( | * - ), 0.66, 0.66, 0.66, 0.69, 0.70 In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 12, 'Grid_RF: Y-Def': 8} ------------------------------------------------------------ Sender: LSF System <lsfadmin@n2i1-5> Subject: Job 192186: </share3/wfu/miniconda/bin/python2.7 run.py run auc false> Done Job </share3/wfu/miniconda/bin/python2.7 run.py run auc false> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>. Job was executed on host(s) <n2i1-5>, in queue <serial>, as user <wfu> in cluster <henry2>. </home/wfu> was used as the home directory. </home/wfu/Github/Caret> was used as the working directory. Started at Sun Feb 21 12:29:24 2016 Results reported at Sun Feb 21 17:35:14 2016 Your job looked like: ------------------------------------------------------------ # LSBATCH: User input /share3/wfu/miniconda/bin/python2.7 run.py run auc false ------------------------------------------------------------ Successfully completed. Resource usage summary: CPU time : 18355.87 sec. Max Memory : 71 MB Max Swap : 719 MB Max Processes : 3 Max Threads : 4 The output (if any) is above this job summary. PS: Read file <./err/auc_false.err.192186> for stderr output of this job.
WeiFoo
commented
8 years ago WeiFoo
commented
8 years ago