CDCgov / pyrenew-hew

Models and infrastructure for forecasting COVID-19 and Flu hospitalizations using wastewater data with PyRenew
Apache License 2.0
5 stars 0 forks source link

Explore options for model versioning #46

Open damonbayer opened 1 month ago

damonbayer commented 1 month ago

Have done a tiny bit of reading on this recently. Broadly, we should be considering "MLOps" tools. A lot of these seem to be proprietary and/or aimed at more traditional machine learning, but maybe some would be useful to us or offer lessons. The main one I keep seeing is https://mlflow.org/

Random example using mlflow with numpyro: https://gitlab.com/tk0345/numpyro-mlflow-example/-/blob/main/numpyro_mlflow_example.ipynb

seabbs commented 1 month ago

Agree

SamuelBrand1 commented 1 month ago

This looks nice.

seabbs commented 1 month ago

I don't know much about this but here is a big list of tools: https://github.com/kelvins/awesome-mlops

IMO I think the key is we use something that has some useful set of features and isn't that hard to get started with not that we make the right choice the first time

damonbayer commented 3 days ago

Also considering https://metaflow.org/