h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.92k stars 2k forks source link

ModelMetrics response has 0 for duration_in_ms and scoring_time #13414

Open exalate-issue-sync[bot] opened 1 year ago

exalate-issue-sync[bot] commented 1 year ago

ModelMetrics response has 0 for duration_in_ms and scoring_time. In addition, I would say scoring_time is a poor name. Names with time should have the units in the name.

a better name would be, for example: scoring_time_ms

http://localhost:54321/3/ModelMetrics.json/models/DeepLearningModel__83c673661004f1951ea80b27b01b4fb6/frames/allyears2k_headers.hex

meta: {schema_version: 3, schema_name: "ModelMetricsListSchemaV3", schema_type: "ModelMetricsList"} model_metrics: [{,…}] 0: {,…} meta: {schema_version: 3, schema_name: "ModelMetricsRegressionV3", schema_type: "ModelMetricsRegression"} duration_in_ms: 0 frame: {meta: {schema_version: 1, schema_name: "FrameKeyV1", schema_type: "Key"},…} frame_checksum: 2353770783152020000 model: {meta: {schema_version: 1, schema_name: "ModelKeyV1", schema_type: "Key"},…} model_category: "Regression" model_checksum: 5292426717692341000 mse: 10471.610626796562 predictions: null scoring_time: 0 sigma: 578.4380082304227 Name Path

exalate-issue-sync[bot] commented 1 year ago

Arno Candel commented: Filled the scoring_time (should probably be called scoring_time_in_ms_since_epoch), but removed duration_in_ms for now.

DinukaH2O commented 1 year ago

JIRA Issue Migration Info

Jira Issue: PUBDEV-422 Assignee: Raymond Peck Reporter: Tom Kraljevic State: Open Fix Version: N/A Attachments: N/A Development PRs: N/A