automl / CAVE

[deprecated] Configuration Assessment, Visualization and Evaluation
https://www.automl.org
BSD 3-Clause "New" or "Revised" License
46 stars 13 forks source link

Cannot fully run the example notebook #298

Open deslay1 opened 3 years ago

deslay1 commented 3 years ago

Hi! I am looking forward to running CAVE to generate some reports for some results that I have. I wanted to first run the notebook in in the examples folder but many of the interesting functions cannot be executed correctly.

In my case, I was able to execute all functions up to cave.feature_importance() but then running cave.pimp_forward_selection() leads to the following error:

ValueError                                Traceback (most recent call last)
<ipython-input-10-2ccc76cc8d12> in <module>
----> 1 cave.pimp_forward_selection()

~/anaconda3/envs/cave/lib/python3.6/site-packages/cave/cavefacade.py in wrap(self, d, *args, **kw)
     67             if self.show_jupyter:
     68                 try:
---> 69                     analyzer.get_jupyter()
     70                 except ImportError as err:
     71                     self.logger.debug(err)

~/anaconda3/envs/cave/lib/python3.6/site-packages/cave/analyzer/base_analyzer.py in get_jupyter(self)
     96             output_notebook()
     97             for bokeh_plot in bokeh_plots:
---> 98                 show(bokeh_plot)
     99         else:
    100             from IPython.core.display import HTML, display

~/anaconda3/envs/cave/lib/python3.6/site-packages/bokeh/io/showing.py in show(obj, browser, new, notebook_handle, notebook_url, **kw)
    134 
    135     if not (isinstance(obj, LayoutDOM) or is_application or callable(obj)):
--> 136         raise ValueError(_BAD_SHOW_MSG)
    137 
    138     # TODO (bev) check callable signature more thoroughly

ValueError: "Invalid object to show. The object to passed to show must be one of:

* a LayoutDOM (e.g. a Plot or Widget or Layout)
* a Bokeh Application
* a callable suitable to an application FunctionHandler

Similarly happens when running cave.cave_ablation()

`cave.cave_fanova()' gives me the following error:

KeyError                                  Traceback (most recent call last)
<ipython-input-12-21d3883f12ae> in <module>
----> 1 cave.cave_fanova()

~/anaconda3/envs/cave/lib/python3.6/site-packages/cave/cavefacade.py in wrap(self, d, *args, **kw)
     67             if self.show_jupyter:
     68                 try:
---> 69                     analyzer.get_jupyter()
     70                 except ImportError as err:
     71                     self.logger.debug(err)

~/anaconda3/envs/cave/lib/python3.6/site-packages/cave/analyzer/parameter_importance/fanova.py in get_jupyter(self)
    108             else:
    109                 # Show table
--> 110                 display(HTML(self.result[b]["Importance"]["table"]))
    111                 # Show plots
    112                 display(*list([Image(filename=d["figure"]) for d in self.result[b]['Marginals'].values()]))

KeyError: 'Importance'

I am running Python 3.6 in a conda environment on Ubuntu. I tried to install jupyter-bokeh in case that was the problem but it required the bokeh package to have version 2.x, which is higher than the one in requirements.txt (v1.1.0) so I did not pursue this further.

Appreciate any help I can get on this!