h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.78k stars 1.99k forks source link

GH-16278: add has_multi_thread flag to as_data_frame #16279

Closed wendycwong closed 3 weeks ago

wendycwong commented 1 month ago

This fixes issue: https://github.com/h2oai/h2o-3/issues/16278.

I basically just add a flag use_multi_thread which will automatically set the context:

with local_context(datatable_enabled=True, polars_enabled=True):

so that the users don't need to set it themselves. This is a request from a customer.

I changed the tests to make sure it works.

wendycwong commented 1 month ago

@tomasfryda @maurever :

I finished the change to remove dependencies on datatable. We are now only using pyarrow/polars for the multi-thread conversion.