microsoft / BackwardCompatibilityML

Project for open sourcing research efforts on Backward Compatibility in Machine Learning
https://backwardcompatibilityml.readthedocs.io/en/latest/
MIT License
71 stars 14 forks source link

Re-instantiating the widgets keeps the old widget settings under the hood instead of re-instantiating them #123

Open ilmarinen opened 3 years ago

ilmarinen commented 3 years ago

If a widget is re-instantiated with new models / parameters etc., then the API endpoints of the widget are still the old endpoints even in the new widget.

So for example, running a sweep on the new widget will give results running the parameters used to instantiate the widget the first time.

This issue is due to the Flask app being at the class level in v0.2.0 of the RAI core library.

In order to fix this, we need to simply make a new release of RAI core (as the issue will be fixed by a change already made there).

And then update our dependencies to point to the new version.