h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.92k stars 2k forks source link

Leaderboard scoring_time extension fails if frames are not available anymore. #7545

Open exalate-issue-sync[bot] opened 1 year ago

exalate-issue-sync[bot] commented 1 year ago

Currently, leaderboard extensions like scoring_time_per_row rely either on the leadeboard frame if present at the time the model is added to the leaderboard, or is computed on demand using the training frame if no leaderboard frame was provided. This can create errors if the training frame is not available anymore when the user asks for the extended leaderboard.

h3. Proposal

h2o-ops commented 1 year ago

JIRA Issue Details

Jira Issue: PUBDEV-8104 Assignee: Sebastien Poirier Reporter: Sebastien Poirier State: Open Fix Version: Backlog Attachments: N/A Development PRs: N/A