fireducks-dev / fireducks

Create an issue on FireDucks
300 stars 5 forks source link

Not working while using Boruta-SHAP package to extract feature importance for Random Forest. Getting warning messages. #24

Open Hemalatanayak opened 1 month ago

Hemalatanayak commented 1 month ago

This is my code.

print(type(train_features_df)) <class 'fireducks.pandas.frame.DataFrame'>

from BorutaShap import BorutaShap

If no model is selected default is the Random Forest

If classification is True it is a classification problem

Feature_Selector = BorutaShap(importance_measure='shap', classification=False)

Feature_Selector.fit(X=train_features_df, y=train_target, n_trials=50, random_state=config['seed'])

I am getting the following error message.

INFO:fireducks.fallback:fallback_attr: name=Index.to_numpy reason=Index.getattr for to_numpy is called INFO:fireducks.fallback:fallback_attr: name=Index.to_list reason=Index.getattr for to_list is called 0%| | 0/50 [00:00<?, ?it/s]INFO:fireducks.fallback:fallback_attr: name=Index.to_numpy reason=Index.getattr for to_numpy is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.apply reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function__ reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_interface reason=Series.getattr for array_interface__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_struct reason=Series.getattr for array_struct__ is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.__array_function reason=None INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.select_dtypes reason=DataFrame.getattr for select_dtypes is called INFO:fireducks.fallback:fallback_attr: name=Index.tolist reason=Index.getattr for tolist is called INFO:fireducks.fallback:fallback_attr: name=pandas.concat reason=axis is not 0 INFO:fireducks.fallback:fallback_attr: name=Series._typ reason=Series.getattr for _typ is called INFO:fireducks.fallback:fallback_attr: name=Series._typ reason=Series.getattr for _typ is called INFO:fireducks.fallback:fallback_attr: name=Index.equals reason=Index.getattr for equals is called INFO:fireducks.fallback:fallback_attr: name=Series.array_struct reason=Series.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Series.array_interface reason=Series.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Series.array reason=dtype is not None INFO:fireducks.fallback:fallback_attr: name=DataFrame.fit reason=DataFrame.getattr for fit is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.fit reason=DataFrame.getattr for fit is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.fit reason=DataFrame.getattr for fit is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.fit reason=DataFrame.getattr for fit is called INFO:fireducks.fallback:fallback_attr: name=Index.array_struct reason=Index.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=Index.array_interface reason=Index.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=Index.array reason=Index.getattr for array is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.dtype reason=DataFrame.getattr for dtype is called INFO:fireducks.fallback:fallback_attr: name=Series.array reason=Series.getattr for array is called INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=DataFrame.sparse reason=DataFrame.getattr for sparse is called INFO:fireducks.fallback:fallback_attr: name=Series.apply reason=Series.getattr for apply is called INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=pandas.SparseDtype reason=borrow SparseDtype from pandas INFO:fireducks.fallback:fallback_attr: name=DataFrame.sparse reason=DataFrame.getattr for sparse is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.array_struct reason=DataFrame.getattr for array_struct is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.array_interface reason=DataFrame.getattr for array_interface is called INFO:fireducks.fallback:fallback_attr: name=DataFrame.array reason=dtype is not None

qsourav commented 1 month ago

Hi @Hemalatanayak,

Thank you for reporting the issue. The reported logs are from fallback, but it is just some performance warning, not an error to stop your program.

Can ypu specify the exact error message stopping your program? Also, please make sure you have used importhook to avoid issues while passing dataframe instances across other libraries:

For notebook: %load_ext fireducks.pandas import pandas as pd from BorutaShap import BorutaShap :

For script: python -mfireducks.pandas script.py

qsourav commented 1 month ago

Also, such fallback warnings are expected to be appeared when you set some specific variables like: FIRE_LOG_LEVEL=1 or FIREDUCKS_FLAGS="-Wfallback"

Do you remember setting any of those? If you want to suppress these warnings, you can avoid setting these variables.