search

scikit-learn-contrib / boruta_py

Python implementations of the Boruta all-relevant feature selection method.
BSD 3-Clause "New" or "Revised" License
1.46k stars 252 forks source link

Finished run of boruta inconsistent with training progress #79

Open nitinmnsn opened 4 years ago

nitinmnsn commented 4 years ago

It seems boruta simply forgot about a features in my training run. i started with 5940 features and max_iter to 200. till final iterations i had iteration:199/200, confirmed: 945, Tentative: 92, Rejected: 4903. But, when boruta finished i got: iteration:200/200, confirmed: 945, Tentative: 28, Rejected: 4903. as you can see Tentative: 92 adds total features to what i started with. 

Iteration:  1 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  2 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  3 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  4 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  5 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  6 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  7 / 200
Confirmed:  0
Tentative:  5940
Rejected:   0
Iteration:  8 / 200
Confirmed:  870
Tentative:  1102
Rejected:   3968
Iteration:  9 / 200
Confirmed:  870
Tentative:  1102
Rejected:   3968
Iteration:  10 / 200
Confirmed:  870
Tentative:  1102
Rejected:   3968
Iteration:  11 / 200
Confirmed:  870
Tentative:  1102
Rejected:   3968
Iteration:  12 / 200
Confirmed:  895
Tentative:  817
Rejected:   4228
Iteration:  13 / 200
Confirmed:  895
Tentative:  817
Rejected:   4228
Iteration:  14 / 200
Confirmed:  895
Tentative:  817
Rejected:   4228
Iteration:  15 / 200
Confirmed:  895
Tentative:  817
Rejected:   4228
Iteration:  16 / 200
Confirmed:  903
Tentative:  676
Rejected:   4361
Iteration:  17 / 200
Confirmed:  903
Tentative:  676
Rejected:   4361
Iteration:  18 / 200
Confirmed:  903
Tentative:  676
Rejected:   4361
Iteration:  19 / 200
Confirmed:  910
Tentative:  580
Rejected:   4450
Iteration:  20 / 200
Confirmed:  910
Tentative:  580
Rejected:   4450
Iteration:  21 / 200
Confirmed:  910
Tentative:  580
Rejected:   4450
Iteration:  22 / 200
Confirmed:  914
Tentative:  576
Rejected:   4450
Iteration:  23 / 200
Confirmed:  914
Tentative:  522
Rejected:   4504
Iteration:  24 / 200
Confirmed:  914
Tentative:  522
Rejected:   4504
Iteration:  25 / 200
Confirmed:  914
Tentative:  522
Rejected:   4504
Iteration:  26 / 200
Confirmed:  916
Tentative:  468
Rejected:   4556
Iteration:  27 / 200
Confirmed:  916
Tentative:  468
Rejected:   4556
Iteration:  28 / 200
Confirmed:  916
Tentative:  468
Rejected:   4556
Iteration:  29 / 200
Confirmed:  920
Tentative:  420
Rejected:   4600
Iteration:  30 / 200
Confirmed:  920
Tentative:  420
Rejected:   4600
Iteration:  31 / 200
Confirmed:  920
Tentative:  420
Rejected:   4600
Iteration:  32 / 200
Confirmed:  920
Tentative:  376
Rejected:   4644
Iteration:  33 / 200
Confirmed:  920
Tentative:  376
Rejected:   4644
Iteration:  34 / 200
Confirmed:  922
Tentative:  332
Rejected:   4686
Iteration:  35 / 200
Confirmed:  922
Tentative:  332
Rejected:   4686
Iteration:  36 / 200
Confirmed:  922
Tentative:  332
Rejected:   4686
Iteration:  37 / 200
Confirmed:  923
Tentative:  331
Rejected:   4686
Iteration:  38 / 200
Confirmed:  923
Tentative:  331
Rejected:   4686
Iteration:  39 / 200
Confirmed:  923
Tentative:  318
Rejected:   4699
Iteration:  40 / 200
Confirmed:  925
Tentative:  316
Rejected:   4699
Iteration:  41 / 200
Confirmed:  925
Tentative:  300
Rejected:   4715
Iteration:  42 / 200
Confirmed:  925
Tentative:  300
Rejected:   4715
Iteration:  43 / 200
Confirmed:  926
Tentative:  276
Rejected:   4738
Iteration:  44 / 200
Confirmed:  926
Tentative:  276
Rejected:   4738
Iteration:  45 / 200
Confirmed:  926
Tentative:  276
Rejected:   4738
Iteration:  46 / 200
Confirmed:  926
Tentative:  258
Rejected:   4756
Iteration:  47 / 200
Confirmed:  926
Tentative:  258
Rejected:   4756
Iteration:  48 / 200
Confirmed:  926
Tentative:  258
Rejected:   4756
Iteration:  49 / 200
Confirmed:  928
Tentative:  238
Rejected:   4774
Iteration:  50 / 200
Confirmed:  928
Tentative:  238
Rejected:   4774
Iteration:  51 / 200
Confirmed:  928
Tentative:  222
Rejected:   4790
Iteration:  52 / 200
Confirmed:  928
Tentative:  222
Rejected:   4790
Iteration:  53 / 200
Confirmed:  928
Tentative:  222
Rejected:   4790
Iteration:  54 / 200
Confirmed:  929
Tentative:  210
Rejected:   4801
Iteration:  55 / 200
Confirmed:  929
Tentative:  210
Rejected:   4801
Iteration:  56 / 200
Confirmed:  929
Tentative:  210
Rejected:   4801
Iteration:  57 / 200
Confirmed:  929
Tentative:  204
Rejected:   4807
Iteration:  58 / 200
Confirmed:  929
Tentative:  204
Rejected:   4807
Iteration:  59 / 200
Confirmed:  929
Tentative:  201
Rejected:   4810
Iteration:  60 / 200
Confirmed:  929
Tentative:  201
Rejected:   4810
Iteration:  61 / 200
Confirmed:  929
Tentative:  201
Rejected:   4810
Iteration:  62 / 200
Confirmed:  929
Tentative:  196
Rejected:   4815
Iteration:  63 / 200
Confirmed:  929
Tentative:  196
Rejected:   4815
Iteration:  64 / 200
Confirmed:  929
Tentative:  196
Rejected:   4815
Iteration:  65 / 200
Confirmed:  929
Tentative:  194
Rejected:   4817
Iteration:  66 / 200
Confirmed:  929
Tentative:  194
Rejected:   4817
Iteration:  67 / 200
Confirmed:  930
Tentative:  190
Rejected:   4820
Iteration:  68 / 200
Confirmed:  930
Tentative:  190
Rejected:   4820
Iteration:  69 / 200
Confirmed:  930
Tentative:  190
Rejected:   4820
Iteration:  70 / 200
Confirmed:  932
Tentative:  187
Rejected:   4821
Iteration:  71 / 200
Confirmed:  932
Tentative:  187
Rejected:   4821
Iteration:  72 / 200
Confirmed:  932
Tentative:  181
Rejected:   4827
Iteration:  73 / 200
Confirmed:  932
Tentative:  181
Rejected:   4827
Iteration:  74 / 200
Confirmed:  932
Tentative:  181
Rejected:   4827
Iteration:  75 / 200
Confirmed:  933
Tentative:  178
Rejected:   4829
Iteration:  76 / 200
Confirmed:  933
Tentative:  178
Rejected:   4829
Iteration:  77 / 200
Confirmed:  933
Tentative:  169
Rejected:   4838
Iteration:  78 / 200
Confirmed:  933
Tentative:  169
Rejected:   4838
Iteration:  79 / 200
Confirmed:  933
Tentative:  169
Rejected:   4838
Iteration:  80 / 200
Confirmed:  934
Tentative:  164
Rejected:   4842
Iteration:  81 / 200
Confirmed:  934
Tentative:  164
Rejected:   4842
Iteration:  82 / 200
Confirmed:  934
Tentative:  164
Rejected:   4842
Iteration:  83 / 200
Confirmed:  934
Tentative:  161
Rejected:   4845
Iteration:  84 / 200
Confirmed:  934
Tentative:  161
Rejected:   4845
Iteration:  85 / 200
Confirmed:  934
Tentative:  157
Rejected:   4849
Iteration:  86 / 200
Confirmed:  934
Tentative:  157
Rejected:   4849
Iteration:  87 / 200
Confirmed:  934
Tentative:  157
Rejected:   4849
Iteration:  88 / 200
Confirmed:  934
Tentative:  155
Rejected:   4851
Iteration:  89 / 200
Confirmed:  934
Tentative:  155
Rejected:   4851
Iteration:  90 / 200
Confirmed:  934
Tentative:  154
Rejected:   4852
Iteration:  91 / 200
Confirmed:  934
Tentative:  154
Rejected:   4852
Iteration:  92 / 200
Confirmed:  934
Tentative:  154
Rejected:   4852
Iteration:  93 / 200
Confirmed:  934
Tentative:  153
Rejected:   4853
Iteration:  94 / 200
Confirmed:  934
Tentative:  153
Rejected:   4853
Iteration:  95 / 200
Confirmed:  935
Tentative:  148
Rejected:   4857
Iteration:  96 / 200
Confirmed:  935
Tentative:  148
Rejected:   4857
Iteration:  97 / 200
Confirmed:  935
Tentative:  148
Rejected:   4857
Iteration:  98 / 200
Confirmed:  935
Tentative:  145
Rejected:   4860
Iteration:  99 / 200
Confirmed:  935
Tentative:  145
Rejected:   4860
Iteration:  100 / 200
Confirmed:  935
Tentative:  140
Rejected:   4865
Iteration:  101 / 200
Confirmed:  935
Tentative:  140
Rejected:   4865
Iteration:  102 / 200
Confirmed:  935
Tentative:  140
Rejected:   4865
Iteration:  103 / 200
Confirmed:  935
Tentative:  140
Rejected:   4865
Iteration:  104 / 200
Confirmed:  935
Tentative:  140
Rejected:   4865
Iteration:  105 / 200
Confirmed:  935
Tentative:  136
Rejected:   4869
Iteration:  106 / 200
Confirmed:  935
Tentative:  136
Rejected:   4869
Iteration:  107 / 200
Confirmed:  935
Tentative:  133
Rejected:   4872
Iteration:  108 / 200
Confirmed:  935
Tentative:  133
Rejected:   4872
Iteration:  109 / 200
Confirmed:  935
Tentative:  133
Rejected:   4872
Iteration:  110 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  111 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  112 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  113 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  114 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  115 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  116 / 200
Confirmed:  935
Tentative:  131
Rejected:   4874
Iteration:  117 / 200
Confirmed:  935
Tentative:  128
Rejected:   4877
Iteration:  118 / 200
Confirmed:  935
Tentative:  128
Rejected:   4877
Iteration:  119 / 200
Confirmed:  935
Tentative:  128
Rejected:   4877
Iteration:  120 / 200
Confirmed:  936
Tentative:  127
Rejected:   4877
Iteration:  121 / 200
Confirmed:  936
Tentative:  127
Rejected:   4877
Iteration:  122 / 200
Confirmed:  936
Tentative:  125
Rejected:   4879
Iteration:  123 / 200
Confirmed:  936
Tentative:  125
Rejected:   4879
Iteration:  124 / 200
Confirmed:  936
Tentative:  125
Rejected:   4879
Iteration:  125 / 200
Confirmed:  936
Tentative:  121
Rejected:   4883
Iteration:  126 / 200
Confirmed:  936
Tentative:  121
Rejected:   4883
Iteration:  127 / 200
Confirmed:  937
Tentative:  120
Rejected:   4883
Iteration:  128 / 200
Confirmed:  937
Tentative:  120
Rejected:   4883
Iteration:  129 / 200
Confirmed:  937
Tentative:  119
Rejected:   4884
Iteration:  130 / 200
Confirmed:  937
Tentative:  119
Rejected:   4884
Iteration:  131 / 200
Confirmed:  937
Tentative:  119
Rejected:   4884
Iteration:  132 / 200
Confirmed:  937
Tentative:  118
Rejected:   4885
Iteration:  133 / 200
Confirmed:  937
Tentative:  118
Rejected:   4885
Iteration:  134 / 200
Confirmed:  937
Tentative:  117
Rejected:   4886
Iteration:  135 / 200
Confirmed:  937
Tentative:  117
Rejected:   4886
Iteration:  136 / 200
Confirmed:  937
Tentative:  117
Rejected:   4886
Iteration:  137 / 200
Confirmed:  938
Tentative:  115
Rejected:   4887
Iteration:  138 / 200
Confirmed:  938
Tentative:  115
Rejected:   4887
Iteration:  139 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  140 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  141 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  142 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  143 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  144 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  145 / 200
Confirmed:  938
Tentative:  114
Rejected:   4888
Iteration:  146 / 200
Confirmed:  939
Tentative:  111
Rejected:   4890
Iteration:  147 / 200
Confirmed:  939
Tentative:  111
Rejected:   4890
Iteration:  148 / 200
Confirmed:  939
Tentative:  111
Rejected:   4890
Iteration:  149 / 200
Confirmed:  939
Tentative:  110
Rejected:   4891
Iteration:  150 / 200
Confirmed:  939
Tentative:  110
Rejected:   4891
Iteration:  151 / 200
Confirmed:  939
Tentative:  110
Rejected:   4891
Iteration:  152 / 200
Confirmed:  939
Tentative:  110
Rejected:   4891
Iteration:  153 / 200
Confirmed:  939
Tentative:  109
Rejected:   4892
Iteration:  154 / 200
Confirmed:  939
Tentative:  109
Rejected:   4892
Iteration:  155 / 200
Confirmed:  939
Tentative:  109
Rejected:   4892
Iteration:  156 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  157 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  158 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  159 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  160 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  161 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  162 / 200
Confirmed:  939
Tentative:  107
Rejected:   4894
Iteration:  163 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  164 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  165 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  166 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  167 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  168 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  169 / 200
Confirmed:  940
Tentative:  105
Rejected:   4895
Iteration:  170 / 200
Confirmed:  941
Tentative:  103
Rejected:   4896
Iteration:  171 / 200
Confirmed:  941
Tentative:  103
Rejected:   4896
Iteration:  172 / 200
Confirmed:  942
Tentative:  101
Rejected:   4897
Iteration:  173 / 200
Confirmed:  942
Tentative:  101
Rejected:   4897
Iteration:  174 / 200
Confirmed:  942
Tentative:  101
Rejected:   4897
Iteration:  175 / 200
Confirmed:  942
Tentative:  100
Rejected:   4898
Iteration:  176 / 200
Confirmed:  942
Tentative:  100
Rejected:   4898
Iteration:  177 / 200
Confirmed:  942
Tentative:  98
Rejected:   4900
Iteration:  178 / 200
Confirmed:  942
Tentative:  98
Rejected:   4900
Iteration:  179 / 200
Confirmed:  942
Tentative:  98
Rejected:   4900
Iteration:  180 / 200
Confirmed:  942
Tentative:  98
Rejected:   4900
Iteration:  181 / 200
Confirmed:  942
Tentative:  98
Rejected:   4900
Iteration:  182 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  183 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  184 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  185 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  186 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  187 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  188 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  189 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  190 / 200
Confirmed:  942
Tentative:  97
Rejected:   4901
Iteration:  191 / 200
Confirmed:  942
Tentative:  96
Rejected:   4902
Iteration:  192 / 200
Confirmed:  942
Tentative:  96
Rejected:   4902
Iteration:  193 / 200
Confirmed:  944
Tentative:  93
Rejected:   4903
Iteration:  194 / 200
Confirmed:  944
Tentative:  93
Rejected:   4903
Iteration:  195 / 200
Confirmed:  944
Tentative:  93
Rejected:   4903
Iteration:  196 / 200
Confirmed:  944
Tentative:  93
Rejected:   4903
Iteration:  197 / 200
Confirmed:  944
Tentative:  93
Rejected:   4903
Iteration:  198 / 200
Confirmed:  945
Tentative:  92
Rejected:   4903
Iteration:  199 / 200
Confirmed:  945
Tentative:  92
Rejected:   4903

BorutaPy finished running.

Iteration:  200 / 200
Confirmed:  945
Tentative:  28
Rejected:   4903

 Time taken: 0 hours 35 minutes and 37.73 seconds.