Compare DE with actual Caret with their data

ai-se / Caret

compare Caret with DE

0 stars 1 forks source link

Open WeiFoo opened 8 years ago

WeiFoo commented 8 years ago

R learner + their data

timm commented 8 years ago

Progress on this? When can we check if caret actually generates the reported improvements?

WeiFoo commented 8 years ago

WeiFoo commented 8 years ago

C5.0:

     Min.   1st Qu.    Median      Mean   3rd Qu.      Max. 
-0.025170  0.002164  0.071170  0.109000  0.218600  0.290000

AVNNet:

     Min.   1st Qu.    Median      Mean   3rd Qu.      Max. 
-0.009183  0.016080  0.033660  0.044440  0.053520  0.149100

CART:

    Min.  1st Qu.   Median     Mean  3rd Qu.     Max. 
-0.04478  0.01746  0.05063  0.10520  0.20120  0.30740

timm commented 8 years ago

[x] so your max improvement is about as big as their medians?
[ ] and, as far as possible, you've matched your rig to their's?
- e.g. data sets etc
- but there is some problem with getting precise details out of them?
- so even the tuning rig needs tuning.... interesting....
[x] runtimes?

CART is the fastest one, take around 30 miniutes(only one parameter), C5.0, and
AVNNet takes overnight.