search

lumen-org / modelbase

A SQL-like interface for python and the web to query probabilistic machine learning models and its data.
GNU Lesser General Public License v3.0
4 stars 1 forks source link

watch changed models #68

Open nandaloo opened 4 years ago

nandaloo commented 4 years ago

A modelbase has the ability to watch for changes in its model directory. Currently it only reacts on new models in the directoy, but does not reload existing models if they are changed. @jong42 requested this feature. Please discuss if this is a desired feature or not, and - if desired - implement it.

nandaloo commented 4 years ago

Con: I am unsure this is a good way to support the incremental workflow of bayesian modelling with ppls. The reason is that overwriting a model makes it impossible to compare the new (incrementally changed) model with the old one.

Pro: It seems the natural thing to do, and the above bayseian modelling is a very specific use case.

Conclusion: I believe the feature should be implemented, but maybe we need some way of 'auotmatically' name incrementally changed models for the ppls use case?

jong42 commented 4 years ago

I also think it should be implemented. We don't loose any functionality: Comparing models is still possible by just naming them differently.