search

sb-ai-lab / LightAutoML

Fast and customizable framework for automatic ML model creation (AutoML)
https://developers.sber.ru/portal/products/lightautoml
Apache License 2.0
1.08k stars 47 forks source link

Failed to run PS3E25 LightAutoML Neural Nets baseline in VS Code #145

Closed sandeshregmi closed 4 months ago

sandeshregmi commented 6 months ago

I downloaded .ipynb file from kaggle and tried running in VS code. It worked for LGBM algorithm but not others. Here is an error I got when I ran MLP. [16:30:57] Stdout logging level is INFO3. [16:30:57] Task: reg

[16:30:57] Start automl preset with listed constraints: [16:30:57] - time: 10000.00 seconds [16:30:57] - CPU: 4 cores [16:30:57] - memory: 16 GB

[16:30:57] Train data shape: (11651, 12)

[16:30:57] Layer 1 train process start. Time left 9999.99 secs [16:30:57] Start fitting Lvl_0_Pipe_0_Mod_0_TorchNN_mlp_0 ... [16:30:57] ===== Start working with fold 0 for Lvl_0_Pipe_0_Mod_0_TorchNN_mlp_0 ===== [16:30:57] Model Lvl_0_Pipe_0_Mod_0_TorchNN_mlp_0 failed during ml_algo.fit_predict call.

'str' object is not callable [16:30:57] Traceback (most recent call last): File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\ml_algo\utils.py", line 72, in tune_and_fit_predict preds = ml_algo.fit_predict(train_valid) File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\ml_algo\dl_model.py", line 472, in fit_predict return super().fit_predict(train_valid_iterator) File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\ml_algo\base.py", line 273, in fit_predict model, pred = self.fit_predict_single_fold(train, valid) File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\ml_algo\dl_model.py", line 498, in fit_predict_single_fold val_pred = model.fit(dataloaders) File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\text\trainer.py", line 430, in fit self._init() File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\text\trainer.py", line 335, in _init self.model = self.net(self.net_params) File "c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\text\nn_model.py", line 295, in init self.cont_embedder = cont_embedder(cont_params) TypeError: 'str' object is not callable

AssertionError Traceback (most recent call last) Cell In[27], line 20 1 algo = 'mlp' 2 automl = TabularAutoML( 3 task = task, 4 timeout = TIMEOUT, (...) 17 reader_params = {'n_jobs': N_THREADS, 'cv': N_FOLDS, 'random_state': RANDOM_STATE, 'advanced_roles': ADVANCED_ROLES} 18 ) ---> 20 oof_pred = automl.fit_predict(tr_data, roles = roles, verbose = 3) 21 test_pred = automl.predict(te_data) 22 oof = score(task, mapped(tr_data[TARGET_NAME].values, task, automl.reader.class_mapping), take_pred_from_task(oof_pred.data, task))

File c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\automl\presets\tabular_presets.py:709, in TabularAutoML.fit_predict(self, train_data, roles, train_features, cv_iter, valid_data, valid_features, log_file, verbose) 706 if self.is_time_series: 707 train = {"seq": {"seq0": train}} --> 709 oof_pred = super().fit_predict(train, roles=roles, cv_iter=cv_iter, valid_data=valid_data, verbose=verbose) 711 return cast(NumpyDataset, oof_pred)

File c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\automl\presets\base.py:207, in AutoMLPreset.fit_predict(self, train_data, roles, train_features, cv_iter, valid_data, valid_features, verbose) 204 logger.info(f"- memory: {self.memory_limit} GB\n") 206 self.timer.start() --> 207 result = super().fit_predict( 208 train_data, 209 roles, 210 train_features, 211 cv_iter, 212 valid_data, 213 valid_features, 214 verbose=verbose, 215 ) 217 logger.info("\x1b[1mAutoml preset training completed in {:.2f} seconds\x1b[0m\n".format(self.timer.time_spent)) 218 logger.info(f"Model description:\n{self.create_model_str_desc()}\n")

File c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\automl\base.py:218, in AutoML.fit_predict(self, train_data, roles, train_features, cv_iter, valid_data, valid_features, verbose) 216 for k, ml_pipe in enumerate(level): 217 ml_pipe.debug = self.debug --> 218 pipe_pred = ml_pipe.fit_predict(train_valid) 219 level_predictions.append(pipe_pred) 220 pipes.append(ml_pipe)

File c:\Users\sregmi444\Anaconda3\envs\test\lib\site-packages\lightautoml\pipelines\ml\base.py:135, in MLPipeline.fit_predict(self, train_valid) 131 self.ml_algos.append(ml_algo) 133 predictions.append(preds) --> 135 assert ( 136 len(predictions) > 0 137 ), "Pipeline finished with 0 models for some reason.\nProbably one or more models failed" 139 predictions = concatenate(predictions) 141 del self._ml_algos

AssertionError: Pipeline finished with 0 models for some reason. Probably one or more models failed

alexmryzhkov commented 6 months ago

@sandeshregmi please try to install LightAutoML before importing any library, that should help.

sandeshregmi commented 6 months ago

@alexmryzhkov Thank you for your suggestion. I followed your suggestion but I still got same error. Here are the list of package dependencies that installed before I imported other packages. Requirement already satisfied: lightautoml==0.3.8b1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (0.3.8b1) Requirement already satisfied: autowoe>=1.2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.3.2) Requirement already satisfied: catboost>=0.26.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.2.2) Requirement already satisfied: cmaes in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (0.10.0) Requirement already satisfied: holidays in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (0.40) Requirement already satisfied: jinja2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (3.1.2) Requirement already satisfied: joblib<1.3.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.2.0) Requirement already satisfied: json2html in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.3.0) Requirement already satisfied: lightgbm<=3.2.1,>=2.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (3.2.1) Requirement already satisfied: networkx in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (3.1) Requirement already satisfied: numpy<1.24.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.23.5) Requirement already satisfied: optuna in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (3.5.0) Requirement already satisfied: pandas<=1.4.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.4.3) Requirement already satisfied: poetry-core<2.0.0,>=1.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.8.1) Requirement already satisfied: pyyaml in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (6.0.1) Requirement already satisfied: scikit-learn>=0.22 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (1.3.2) Requirement already satisfied: seaborn in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (0.13.1) Requirement already satisfied: statsmodels<=0.14.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (0.14.0) Requirement already satisfied: torch>=1.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (2.1.2) Requirement already satisfied: tqdm in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml==0.3.8b1) (4.66.1) Requirement already satisfied: StrEnum<0.5.0,>=0.4.7 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (0.4.15) Requirement already satisfied: matplotlib in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (3.7.4) Requirement already satisfied: pytest in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (7.4.4) Requirement already satisfied: pytz in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (2023.3.post1) Requirement already satisfied: scipy in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (1.10.1) Requirement already satisfied: sphinx in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (7.1.2) Requirement already satisfied: sphinx-rtd-theme in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml==0.3.8b1) (2.0.0) Requirement already satisfied: graphviz in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from catboost>=0.26.1->lightautoml==0.3.8b1) (0.20.1) Requirement already satisfied: plotly in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from catboost>=0.26.1->lightautoml==0.3.8b1) (5.18.0) Requirement already satisfied: six in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from catboost>=0.26.1->lightautoml==0.3.8b1) (1.16.0) Requirement already satisfied: wheel in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightgbm<=3.2.1,>=2.3->lightautoml==0.3.8b1) (0.41.2) Requirement already satisfied: python-dateutil>=2.8.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pandas<=1.4.3->lightautoml==0.3.8b1) (2.8.2) Requirement already satisfied: threadpoolctl>=2.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from scikit-learn>=0.22->lightautoml==0.3.8b1) (3.2.0) Requirement already satisfied: patsy>=0.5.2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from statsmodels<=0.14.0->lightautoml==0.3.8b1) (0.5.5) Requirement already satisfied: packaging>=21.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from statsmodels<=0.14.0->lightautoml==0.3.8b1) (23.2) Requirement already satisfied: filelock in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml==0.3.8b1) (3.13.1) Requirement already satisfied: typing-extensions in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml==0.3.8b1) (4.9.0) Requirement already satisfied: sympy in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml==0.3.8b1) (1.12) Requirement already satisfied: fsspec in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml==0.3.8b1) (2023.12.2) Requirement already satisfied: colorama in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from tqdm->lightautoml==0.3.8b1) (0.4.6) Requirement already satisfied: MarkupSafe>=2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from jinja2->lightautoml==0.3.8b1) (2.1.3) Requirement already satisfied: alembic>=1.5.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from optuna->lightautoml==0.3.8b1) (1.13.1) Requirement already satisfied: colorlog in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from optuna->lightautoml==0.3.8b1) (6.8.0) Requirement already satisfied: sqlalchemy>=1.3.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from optuna->lightautoml==0.3.8b1) (2.0.25) Requirement already satisfied: Mako in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from alembic>=1.5.0->optuna->lightautoml==0.3.8b1) (1.3.0) Requirement already satisfied: importlib-metadata in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from alembic>=1.5.0->optuna->lightautoml==0.3.8b1) (7.0.1) Requirement already satisfied: importlib-resources in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from alembic>=1.5.0->optuna->lightautoml==0.3.8b1) (6.1.1) Requirement already satisfied: contourpy>=1.0.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml==0.3.8b1) (1.1.1) Requirement already satisfied: cycler>=0.10 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml==0.3.8b1) (0.12.1) Requirement already satisfied: fonttools>=4.22.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml==0.3.8b1) (4.47.0) Requirement already satisfied: kiwisolver>=1.0.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml==0.3.8b1) (1.4.5) Requirement already satisfied: pillow>=6.2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml==0.3.8b1) (10.2.0) Requirement already satisfied: pyparsing>=2.3.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml==0.3.8b1) (3.1.1) Requirement already satisfied: greenlet!=0.4.17 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sqlalchemy>=1.3.0->optuna->lightautoml==0.3.8b1) (3.0.3) Requirement already satisfied: tenacity>=6.2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from plotly->catboost>=0.26.1->lightautoml==0.3.8b1) (8.2.3) Requirement already satisfied: iniconfig in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml==0.3.8b1) (2.0.0) Requirement already satisfied: pluggy<2.0,>=0.12 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml==0.3.8b1) (1.3.0) Requirement already satisfied: exceptiongroup>=1.0.0rc8 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml==0.3.8b1) (1.2.0) Requirement already satisfied: tomli>=1.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml==0.3.8b1) (2.0.1) Requirement already satisfied: sphinxcontrib-applehelp in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (1.0.4) Requirement already satisfied: sphinxcontrib-devhelp in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (1.0.2) Requirement already satisfied: sphinxcontrib-jsmath in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (1.0.1) Requirement already satisfied: sphinxcontrib-htmlhelp>=2.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2.0.1) Requirement already satisfied: sphinxcontrib-serializinghtml>=1.1.5 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (1.1.5) Requirement already satisfied: sphinxcontrib-qthelp in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (1.0.3) Requirement already satisfied: Pygments>=2.13 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2.17.2) Requirement already satisfied: docutils<0.21,>=0.18.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (0.20.1) Requirement already satisfied: snowballstemmer>=2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2.2.0) Requirement already satisfied: babel>=2.9 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2.14.0) Requirement already satisfied: alabaster<0.8,>=0.7 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (0.7.13) Requirement already satisfied: imagesize>=1.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (1.4.1) Requirement already satisfied: requests>=2.25.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2.31.0) Requirement already satisfied: sphinxcontrib-jquery<5,>=4 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx-rtd-theme->autowoe>=1.2->lightautoml==0.3.8b1) (4.1) Requirement already satisfied: mpmath>=0.19 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sympy->torch>=1.0.0->lightautoml==0.3.8b1) (1.3.0) Requirement already satisfied: zipp>=0.5 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from importlib-metadata->alembic>=1.5.0->optuna->lightautoml==0.3.8b1) (3.17.0) Requirement already satisfied: charset-normalizer<4,>=2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests>=2.25.0->sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (3.3.2) Requirement already satisfied: idna<4,>=2.5 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests>=2.25.0->sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (3.6) Requirement already satisfied: urllib3<3,>=1.21.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests>=2.25.0->sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests>=2.25.0->sphinx->autowoe>=1.2->lightautoml==0.3.8b1) (2023.11.17) Requirement already satisfied: lightautoml[nlp] in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (0.3.8b1) Requirement already satisfied: autowoe>=1.2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.3.2) Requirement already satisfied: catboost>=0.26.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.2.2) Requirement already satisfied: cmaes in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (0.10.0) Requirement already satisfied: holidays in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (0.40) Requirement already satisfied: jinja2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (3.1.2) Requirement already satisfied: joblib<1.3.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.2.0) Requirement already satisfied: json2html in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.3.0) Requirement already satisfied: lightgbm<=3.2.1,>=2.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (3.2.1) Requirement already satisfied: networkx in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (3.1) Requirement already satisfied: numpy<1.24.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.23.5) Requirement already satisfied: optuna in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (3.5.0) Requirement already satisfied: pandas<=1.4.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.4.3) Requirement already satisfied: poetry-core<2.0.0,>=1.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.8.1) Requirement already satisfied: pyyaml in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (6.0.1) Requirement already satisfied: scikit-learn>=0.22 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (1.3.2) Requirement already satisfied: seaborn in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (0.13.1) Requirement already satisfied: statsmodels<=0.14.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (0.14.0) Requirement already satisfied: torch>=1.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (2.1.2) Requirement already satisfied: tqdm in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (4.66.1) Requirement already satisfied: gensim>=4 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (4.3.2) Requirement already satisfied: nltk in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (3.8.1) Requirement already satisfied: transformers>=4 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightautoml[nlp]) (4.36.2) Requirement already satisfied: StrEnum<0.5.0,>=0.4.7 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (0.4.15) Requirement already satisfied: matplotlib in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (3.7.4) Requirement already satisfied: pytest in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (7.4.4) Requirement already satisfied: pytz in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (2023.3.post1) Requirement already satisfied: scipy in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (1.10.1) Requirement already satisfied: sphinx in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (7.1.2) Requirement already satisfied: sphinx-rtd-theme in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from autowoe>=1.2->lightautoml[nlp]) (2.0.0) Requirement already satisfied: graphviz in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from catboost>=0.26.1->lightautoml[nlp]) (0.20.1) Requirement already satisfied: plotly in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from catboost>=0.26.1->lightautoml[nlp]) (5.18.0) Requirement already satisfied: six in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from catboost>=0.26.1->lightautoml[nlp]) (1.16.0) Requirement already satisfied: smart-open>=1.8.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from gensim>=4->lightautoml[nlp]) (6.4.0) Requirement already satisfied: wheel in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from lightgbm<=3.2.1,>=2.3->lightautoml[nlp]) (0.41.2) Requirement already satisfied: python-dateutil>=2.8.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pandas<=1.4.3->lightautoml[nlp]) (2.8.2) Requirement already satisfied: threadpoolctl>=2.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from scikit-learn>=0.22->lightautoml[nlp]) (3.2.0) Requirement already satisfied: patsy>=0.5.2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from statsmodels<=0.14.0->lightautoml[nlp]) (0.5.5) Requirement already satisfied: packaging>=21.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from statsmodels<=0.14.0->lightautoml[nlp]) (23.2) Requirement already satisfied: filelock in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml[nlp]) (3.13.1) Requirement already satisfied: typing-extensions in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml[nlp]) (4.9.0) Requirement already satisfied: sympy in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml[nlp]) (1.12) Requirement already satisfied: fsspec in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from torch>=1.0.0->lightautoml[nlp]) (2023.12.2) Requirement already satisfied: colorama in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from tqdm->lightautoml[nlp]) (0.4.6) Requirement already satisfied: huggingface-hub<1.0,>=0.19.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from transformers>=4->lightautoml[nlp]) (0.20.1) Requirement already satisfied: regex!=2019.12.17 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from transformers>=4->lightautoml[nlp]) (2023.12.25) Requirement already satisfied: requests in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from transformers>=4->lightautoml[nlp]) (2.31.0) Requirement already satisfied: tokenizers<0.19,>=0.14 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from transformers>=4->lightautoml[nlp]) (0.15.0) Requirement already satisfied: safetensors>=0.3.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from transformers>=4->lightautoml[nlp]) (0.4.1) Requirement already satisfied: MarkupSafe>=2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from jinja2->lightautoml[nlp]) (2.1.3) Requirement already satisfied: click in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from nltk->lightautoml[nlp]) (8.1.7) Requirement already satisfied: alembic>=1.5.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from optuna->lightautoml[nlp]) (1.13.1) Requirement already satisfied: colorlog in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from optuna->lightautoml[nlp]) (6.8.0) Requirement already satisfied: sqlalchemy>=1.3.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from optuna->lightautoml[nlp]) (2.0.25) Requirement already satisfied: Mako in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from alembic>=1.5.0->optuna->lightautoml[nlp]) (1.3.0) Requirement already satisfied: importlib-metadata in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from alembic>=1.5.0->optuna->lightautoml[nlp]) (7.0.1) Requirement already satisfied: importlib-resources in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from alembic>=1.5.0->optuna->lightautoml[nlp]) (6.1.1) Requirement already satisfied: contourpy>=1.0.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml[nlp]) (1.1.1) Requirement already satisfied: cycler>=0.10 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml[nlp]) (0.12.1) Requirement already satisfied: fonttools>=4.22.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml[nlp]) (4.47.0) Requirement already satisfied: kiwisolver>=1.0.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml[nlp]) (1.4.5) Requirement already satisfied: pillow>=6.2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml[nlp]) (10.2.0) Requirement already satisfied: pyparsing>=2.3.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from matplotlib->autowoe>=1.2->lightautoml[nlp]) (3.1.1) Requirement already satisfied: greenlet!=0.4.17 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sqlalchemy>=1.3.0->optuna->lightautoml[nlp]) (3.0.3) Requirement already satisfied: tenacity>=6.2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from plotly->catboost>=0.26.1->lightautoml[nlp]) (8.2.3) Requirement already satisfied: iniconfig in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml[nlp]) (2.0.0) Requirement already satisfied: pluggy<2.0,>=0.12 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml[nlp]) (1.3.0) Requirement already satisfied: exceptiongroup>=1.0.0rc8 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml[nlp]) (1.2.0) Requirement already satisfied: tomli>=1.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from pytest->autowoe>=1.2->lightautoml[nlp]) (2.0.1) Requirement already satisfied: charset-normalizer<4,>=2 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests->transformers>=4->lightautoml[nlp]) (3.3.2) Requirement already satisfied: idna<4,>=2.5 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests->transformers>=4->lightautoml[nlp]) (3.6) Requirement already satisfied: urllib3<3,>=1.21.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests->transformers>=4->lightautoml[nlp]) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from requests->transformers>=4->lightautoml[nlp]) (2023.11.17) Requirement already satisfied: sphinxcontrib-applehelp in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (1.0.4) Requirement already satisfied: sphinxcontrib-devhelp in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (1.0.2) Requirement already satisfied: sphinxcontrib-jsmath in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (1.0.1) Requirement already satisfied: sphinxcontrib-htmlhelp>=2.0.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (2.0.1) Requirement already satisfied: sphinxcontrib-serializinghtml>=1.1.5 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (1.1.5) Requirement already satisfied: sphinxcontrib-qthelp in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (1.0.3) Requirement already satisfied: Pygments>=2.13 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (2.17.2) Requirement already satisfied: docutils<0.21,>=0.18.1 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (0.20.1) Requirement already satisfied: snowballstemmer>=2.0 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (2.2.0) Requirement already satisfied: babel>=2.9 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (2.14.0) Requirement already satisfied: alabaster<0.8,>=0.7 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (0.7.13) Requirement already satisfied: imagesize>=1.3 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx->autowoe>=1.2->lightautoml[nlp]) (1.4.1) Requirement already satisfied: sphinxcontrib-jquery<5,>=4 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sphinx-rtd-theme->autowoe>=1.2->lightautoml[nlp]) (4.1) Requirement already satisfied: mpmath>=0.19 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from sympy->torch>=1.0.0->lightautoml[nlp]) (1.3.0) Requirement already satisfied: zipp>=0.5 in [c:\users\sregmi444\anaconda3\envs\test\lib\site-packages](file:///C:/users/sregmi444/anaconda3/envs/test/lib/site-packages) (from importlib-metadata->alembic>=1.5.0->optuna->lightautoml[nlp]) (3.17.0)

BELONOVSKII commented 5 months ago

Hello @sandeshregmi! Can you please tell me the way you installed LightAutoML? I have tried to run the code with the installed lightautoml-0.3.8-py3-none-any.whl from kaggle notebook and everything worked well.

Moreover, I have tried the same with cloning and building the LightAutoML master branch and, again, have successfully run the scripts in the notebook.

Nevertheless, I was able to reproduce this error by installing LightAutoML with pip install lightautoml==0.3.8b1. Unfortunately, current PyPI version 0.3.8b1 of LightAutoML contains minor bugs that were fixed by #123.

If you used pip install lightautoml==0.3.8b1, please try to uninstall LightAutoML and install it by any of the methods presented above.

sandeshregmi commented 5 months ago

@BELONOVSKII Thank you! for me following version worked !pip install lightautoml-0.3.9b1-py3-none-any.whl !pip install -U lightautoml[nlp]

sandeshregmi commented 5 months ago

@BELONOVSKII Also, do you have a suggestion or (notebook) to do model explanation analysis for a model built by for example 'fttransformer'?

alexmryzhkov commented 5 months ago

@sandeshregmi you can use this kernel as a reference how to use FTTransformer - it is the last one in the list.

sandeshregmi commented 5 months ago

@alexmryzhkov Thank you! Sorry I was not very descriptive in my question. Do you think we can generate something similar to SHAP plot ? Or Attention weights based feature importance?

BELONOVSKII commented 5 months ago

@sandeshregmi Hello! LightAutoML has an implementation of SSWARM algorithm for model-agnostic computations of Shapley values. This algorithm computes Shapley values for compositions of any ML models (not only tree-based). For now, this algorithm is not released in GitHub or PyPI (will come in the near future), nevertheless, I have a .whl file with it. I have created an example notebook on Kaggle that demonstrates how to obtain Shapley values and generate SHAP plots.

sandeshregmi commented 5 months ago

@BELONOVSKII Thank you! Only .whl file works for me is !pip install lightautoml-0.3.9b1-py3-none-any.whl. Do I need to uninstall it and install lightautoml-0.3.8b1-py3-none-any.whl ?

alexmryzhkov commented 5 months ago

@sandeshregmi yes, you need to uninstall 0.3.9b1 and use the whl file @BELONOVSKII provided because it is the only current version which hav SSWARM algo to calc shapely values based on lightautoml models

sandeshregmi commented 5 months ago

@BELONOVSKII Awesome! It worked. Thank you

sandeshregmi commented 5 months ago

@BELONOVSKII One thing I noticed is though zaratio. I am not sure what it represents. Untitled

BELONOVSKII commented 5 months ago

@sandeshregmi Hello. zaratio_Average is just a feature of initial dataset.

sandeshregmi commented 5 months ago

@BELONOVSKII Could you please review this code. I am getting same feature name for interaction_index in every plot. I wonder if you need to update feats[0]! feats = explainer.used_feats fig, ax = plt.subplots(nrows=len(feats), ncols=1, figsize=(10, 5*len(feats)))

for i, feat in enumerate(feats): shap.dependence_plot(feat, shap_values_lgb, te_data[explainer.used_feats], show=False, ax=ax[i], interaction_index=feats[0])

BELONOVSKII commented 5 months ago

@sandeshregmi Hello! Yes, in this code I have manually set the interaction feature for each plot ( the first feature in the list ). However, you can set any other feature for interaction, or set the parameter to "auto".

Read more in the shap.dependence_plot documentation.