pd.DataFrame.sparse supported in environment?

HunterMcGushion / hyperparameter_hunter

Easy hyperparameter optimization and automatic result saving across machine learning algorithms and libraries

MIT License

704 stars 100 forks source link

Open puffofsmoke opened 4 years ago

puffofsmoke commented 4 years ago

Trying to create new environment to make some experiments with LogisticRegression.

Look like Environment support only Pandas.DataFrame.

No problem, created by pd.DataFrame.sparse.from_spmatrix(X_train_data) because I have too many data (250000 rows × 50000 columns) and I using csr_matrix to store data in memory.
Now I run code to create environment and it frozen for a long time.

Any suggestions?