h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.92k stars 2k forks source link

PCA model : Core dump #15422

Closed exalate-issue-sync[bot] closed 1 year ago

exalate-issue-sync[bot] commented 1 year ago

Steps to reproduce :

1) Started h2o as below from latest master:

java -Xmx5g -jar -ea h2o.jar -experimental -name no

2) importFiles [ "/Users/nmadabhushi/0xdata/h2o-dev/smalldata/airlines/allyears2k.zip" ]

3) Parse 4) getFrameSummary "allyears2k.hex" 5) buildModel 'pca', {"model_id":"pca-1-82378c30-3b15-4bbb-9c39-92a6e2a31727","training_frame":"allyears2k.hex","ignored_columns":["C5","C7","C12","C14","C15","C16","C20","C21","C23","C25","C26","C27","C28","C29"],"ignore_const_cols":true,"transform":"STANDARDIZE","pca_method":"GramSVD","k":1,"max_iterations":1000,"seed":1436311869164163000,"loading_name":"PCALoading__88734f699adcd39b8c2788093ec74e7c","use_all_factor_levels":false,"score_each_iteration":false}

On the terminal

07-07 17:09:09.755 10.0.0.5:54321 62801 FJ-0-3 INFO: {"_model_id":{"name":"pca-1-82378c30-3b15-4bbb-9c39-92a6e2a31727","type":"Key"},"_train":{"name":"allyears2k.hex","type":"Key"},"_valid":null,"_ignored_columns":["C5","C7","C12","C14","C15","C16","C20","C21","C23","C25","C26","C27","C28","C29"],"_ignore_const_cols":true,"_weights_column":null,"_offset_column":null,"_score_each_iteration":false,"_response_column":null,"_balance_classes":false,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_transform":"STANDARDIZE","_pca_method":"GramSVD","_k":1,"_max_iterations":1000,"_seed":1436311869164163000,"_loading_name":"PCALoading__88734f699adcd39b8c2788093ec74e7c","_keep_loading":true,"_use_all_factor_levels":false} 07-07 17:09:09.756 10.0.0.5:54321 62801 FJ-0-3 INFO: Dropping ignored columns: [C5, C7, C12, C14, C15, C16, C20, C21, C23, C25, C26, C27, C28, C29] #

A fatal error has been detected by the Java Runtime Environment:

#

Internal Error (safepoint.cpp:318), pid=62801, tid=12547

guarantee(PageArmed == 0) failed: invariant

#

JRE version: Java(TM) SE Runtime Environment (7.0_71-b14) (build 1.7.0_71-b14)

Java VM: Java HotSpot(TM) 64-Bit Server VM (24.71-b01 mixed mode bsd-amd64 compressed oops)

Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

#

An error report file with more information is saved as:

/Users/nmadabhushi/0xdata/h2o-dev/build/hs_err_pid62801.log

#

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

# Abort trap: 6

Please checked attached file....

exalate-issue-sync[bot] commented 1 year ago

Neeraja Madabhushi commented: This is reproducible...

exalate-issue-sync[bot] commented 1 year ago

Neeraja Madabhushi commented: On h2o-2 it did complete after 1.5 hrs

Attached is screenshot on completed job.

exalate-issue-sync[bot] commented 1 year ago

Former user commented: I tried using the h2o-2 JAMA jar file, and it completed successfully in 22 minutes (see attached screenshot). I will run it a few more times to ensure this wasn't an intermittent failure. Stay tuned...

exalate-issue-sync[bot] commented 1 year ago

Former user commented: Running a test for this exact case on Jenkins to see if any errors pop up: http://172.16.2.161:8080/view/Experimental/job/h2o_master_DEV_PCA_runit_small/

exalate-issue-sync[bot] commented 1 year ago

Former user commented: Jenkins job on two different machines continuously passes. I'm closing this unless someone can reproduce this consistently.

DinukaH2O commented 1 year ago

JIRA Issue Migration Info

Jira Issue: PUBDEV-1652 Assignee: Former user Reporter: Neeraja Madabhushi State: Resolved Fix Version: N/A Attachments: Available (Count: 8) Development PRs: N/A

Attachments From Jira

Attachment Name: hs_err_pid62801.log Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/hs_err_pid62801.log

Attachment Name: hs_err_pid62921.log Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/hs_err_pid62921.log

Attachment Name: Screen Shot 2015-07-07 at 6.58.37 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/Screen Shot 2015-07-07 at 6.58.37 PM.png

Attachment Name: Screen Shot 2015-07-07 at 6.58.37 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/Screen Shot 2015-07-07 at 6.58.37 PM.png

Attachment Name: Screen Shot 2015-07-07 at 7.02.04 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/Screen Shot 2015-07-07 at 7.02.04 PM.png

Attachment Name: Screen Shot 2015-07-08 at 3.04.47 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/Screen Shot 2015-07-08 at 3.04.47 PM.png

Attachment Name: Screen Shot 2015-07-08 at 4.06.45 PM.png Attached By: Neeraja Madabhushi File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/Screen Shot 2015-07-08 at 4.06.45 PM.png

Attachment Name: Screenshot 2015-07-09 13.28.17.png Attached By: Former user File Link:https://h2o-3-jira-github-migration.s3.amazonaws.com/PUBDEV-1652/Screenshot 2015-07-09 13.28.17.png