Flow : getPredictions => Compare selected predictions => Not working

[exalate-issue-sync[bot]]

Steps to reproduce :

1) On ec2 cluster neeraja.h2o.ai build 1171 2) Import file : importFiles [ "s3n://h2o-datasets/allyears2k.csv" ] 3) Parse files 4) Build DRF model : buildModel 'drf', {"model_id":"drf-c8568fc7-1c1a-4d00-bc90-24b5df718c59","training_frame":"allyears2k.hex","drop_na20_cols":false,"score_each_iteration":false,"response_column":"IsDepDelayed","ntrees":"10","max_depth":"5","min_rows":10,"nbins":20,"mtries":-1,"sample_rate":0.6666667,"build_tree_one_node":false,"balance_classes":false,"seed":0}

5) Build Deep learning

buildModel 'deeplearning', {"model_id":"deeplearning-f9c3a96d-10f4-4980-9ae9-6a76616c4d6e","training_frame":"allyears2k.hex","drop_na20_cols":false,"response_column":"IsDepDelayed","activation":"Rectifier","hidden":[50,50],"epochs":"1","variable_importances":false,"balance_classes":false,"checkpoint":"","use_all_factor_levels":true,"train_samples_per_iteration":-2,"adaptive_rate":true,"input_dropout_ratio":0,"l1":0,"l2":0,"loss":"Automatic","score_interval":5,"score_training_samples":10000,"score_duty_cycle":0.1,"replicate_training_data":true,"autoencoder":false,"override_with_best_model":true,"target_ratio_comm_to_comp":0.02,"seed":-5546964467632504000,"rho":0.99,"epsilon":1e-8,"max_w2":"Infinity","initial_weight_distribution":"UniformAdaptive","classification_stop":0,"diagnostics":true,"fast_mode":true,"ignore_const_cols":true,"force_load_balance":true,"single_node_mode":false,"shuffle_training_data":false,"missing_values_handling":"MeanImputation","quiet_mode":false,"sparse":false,"col_major":false,"average_activation":0,"sparsity_beta":0,"max_categorical_features":2147483647,"reproducible":false,"export_weights_and_biases":false}

6) Build GBM Model

buildModel 'gbm', {"model_id":"gbm-a01401cb-fd81-43d0-a9fb-9cf6a89f732a","training_frame":"allyears2k.hex","drop_na20_cols":false,"score_each_iteration":false,"response_column":"IsDepDelayed","ntrees":50,"max_depth":5,"min_rows":10,"nbins":20,"learn_rate":0.1,"distribution":"AUTO","balance_classes":false,"seed":0}

7) Build K Means buildModel 'kmeans', {"model_id":"kmeans-07753051-fe71-4a94-91fb-30ddfdb46963","training_frame":"allyears_1987_20131.hex","drop_na20_cols":false,"score_each_iteration":false,"k":1,"max_iterations":1000,"init":"Furthest","standardize":true,"seed":770583404951360}

8) GetPredictions 9) Compare selected predictions

Does nothing

[exalate-issue-sync[bot]]

Prithvi Prabhu commented: This was intended to trigger the multi-model comparison function, which is not implemented yet. Moving to backlog.

[DinukaH2O]

JIRA Issue Migration Info

Jira Issue: PUBDEV-973 Assignee: Prithvi Prabhu Reporter: Neeraja Madabhushi State: Open Fix Version: N/A Attachments: Available (Count: 2) Development PRs: N/A

Attachments From Jira

Attachment Name: Screen Shot 2015-04-28 at 5.58.26 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-973/Screen Shot 2015-04-28 at 5.58.26 PM.png

Attachment Name: Screen Shot 2015-04-28 at 6.15.25 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-973/Screen Shot 2015-04-28 at 6.15.25 PM.png